Qwen2.5-7B-Instruct
State‑of‑the‑art large language model useful on a variety of language understanding and generation tasks.
The Qwen2.5‑7B‑Instruct is a state‑of‑the‑art multilingual language model with 7 billion parameters, excelling in language understanding, generation, coding, and mathematics.
Technical Details
Input sequence length for Prompt Processor:128
Context length:4096
Precision:w4a16 + w8a16 (few layers)
Supported languages:Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.
TTFT:Time To First Token is the time it takes to generate the first response token. This is expressed as a range because it varies based on the length of the prompt. The lower bound is for a short prompt (up to 128 tokens, i.e., one iteration of the prompt processor) and the upper bound is for a prompt using the full context length (4096 tokens).
Response Rate:Rate of response generation after the first response token.
Applicable Scenarios
- Dialogue
- Content Generation
- Customer Support
Supported Form Factors
- Phone
- Tablet
License
Model:APACHE-2.0
Terms of Use:Qualcomm® Generative AI usage and limitations
Tags
- llm
- generative-ai
Supported Devices
- Snapdragon X Elite CRD
Supported Chipsets
- Snapdragon® X Elite
Related Models
See all models
Looking for more? See models created by industry leaders.
Discover Model Makers