Qualcomm® AI HubAI Hub

Llama-v3.2-1B-Instruct

State‑of‑the‑art large language model useful on a variety of language understanding and generation tasks.

Llama 3 is a family of LLMs. The model is quantized to w4 (4‑bit weights) and part of the model is quantized to w8 (8‑bit weights) making it suitable for on‑device deployment.

View README
Not supported

This model is currently not supported on any IoT chipset.

To see performance metrics for this model on other chipsets, click the button below.

View for other chipsets
Model RepositoryHugging FaceResearch Paper

Technical Details

Response Rate:Rate of response generation after the first response token.
Supported languages:English.

Applicable Scenarios

  • Dialogue
  • Content Generation
  • Customer Support

License

Model:LLAMA3
Terms of Use:Qualcomm® Generative AI usage and limitations

Tags

  • llm
  • generative-ai

Supported IoT Devices

  • Arduino VENTUNO Q
  • Dragonwing IQ-9075 EVK
  • Dragonwing IQ-X5121
  • Dragonwing IQ-X7181
  • Dragonwing Q-8750

Supported IoT Chipsets

  • Qualcomm® QCS5121
  • Qualcomm® Dragonwing™ IQ-X7181
  • Qualcomm® Dragonwing™ IQ-8275
  • Qualcomm® Dragonwing™ Q-8750
  • Qualcomm® Dragonwing™ IQ-9075

Related Models

See all models
View details for the Llama-v3-8B-Instruct model.

Llama-v3-8B-Instruct

State-of-the-art large language model useful on a variety of language understanding and generation tasks.

View details for the Llama-v3.1-8B-Instruct model.

Llama-v3.1-8B-Instruct

State-of-the-art large language model useful on a variety of language understanding and generation tasks.

View details for the Llama-v3.2-3B-Instruct model.

Llama-v3.2-3B-Instruct

State-of-the-art large language model useful on a variety of language understanding and generation tasks.

Looking for more? See models created by industry leaders.

Discover Model Makers