Qualcomm® AI HubAI Hub

Qwen2-7B-Instruct

State‑of‑the‑art large language model useful on a variety of language understanding and generation tasks.

The Qwen2‑7B‑Instruct is a state‑of‑the‑art multilingual language model with 7.07 billion parameters, excelling in language understanding, generation, coding, and mathematics.

Not supported

This model is currently not supported on any All Models chipset.

To see performance metrics for this model on other chipsets, click the button below.

View for other chipsets

Technical Details

Context length:4096
Information about the model parts:Prompt Processor and Token Generator are split into 5 parts each. Each corresponding Prompt Processor and Token Generator part share weights.
Input sequence length for Prompt Processor:128
Number of parameters:7.07B
Quantization Type:w4a16 + w8a16 (few layers)
Response Rate:Rate of response generation after the first response token.
Supported languages:English, Chinese, German, French, Spanish, Portuguese, Italian, Dutch, Russian, Czech, Polish, Arabic, Persian, Hebrew, Turkish, Japanese, Korean, Vietnamese, Thai, Indonesian, Malay, Lao, Burmese, Cebuano, Khmer, Tagalog, Hindi, Bengali, Urdu.

Applicable Scenarios

  • Dialogue
  • Content Generation
  • Customer Support

License

Tags

  • llm
  • generative-ai

Supported Devices

  • Dragonwing Q-8750

Supported Chipsets

  • Qualcomm® Dragonwing™ Q-8750
  • Snapdragon® 8 Elite For Galaxy Mobile

Looking for more? See models created by industry leaders.

Discover Model Makers