Phi-3.5-Mini-Instruct
State‑of‑the‑art large language model useful on a variety of language understanding and generation tasks.
Phi‑3.5‑mini is a lightweight, state‑of‑the‑art open model built upon datasets used for Phi‑3 ‑ synthetic data and filtered publicly available websites ‑ with a focus on very high‑quality, reasoning dense data. The model belongs to the Phi‑3 model family and supports 128K token context length. The model underwent a rigorous enhancement process, incorporating both supervised fine‑tuning, proximal policy optimization, and direct preference optimization to ensure precise instruction adherence and robust safety measures.
Not supported
This model is currently not supported on any All Models chipset.
To see performance metrics for this model on other chipsets, click the button below.
View for other chipsetsTechnical Details
Context lengths:512, 1024, 2048, 3072, 4096
Input sequence length for Prompt Processor:128
Minimum QAIRT SDK:2.43.1
Number of parameters:3.8B
Quantization Type:w4a16 + w8a16 (few layers)
Response Rate:Rate of response generation after the first response token.
Applicable Scenarios
- Dialogue
- Content Generation
- Customer Support
Supported Form Factors
- Compute
- IoT
License
Model:MIT
Terms of Use:Qualcomm® Generative AI usage and limitations
Tags
- llm
- generative-ai
Supported Devices
- Dragonwing IQ-X7181
- Snapdragon X Elite CRD
- Snapdragon X Plus 8-Core CRD
- Snapdragon X2 Elite CRD
Supported Chipsets
- Qualcomm® Dragonwing™ IQ-X7181
- Snapdragon® X Elite
- Snapdragon® X Plus 8-Core
- Snapdragon® X2 Elite
Looking for more? See models created by industry leaders.
Discover Model Makers








