Qualcomm® AI HubAI Hub

Phi-3.5-Mini-Instruct

State‑of‑the‑art large language model useful on a variety of language understanding and generation tasks.

Phi‑3.5‑mini is a lightweight, state‑of‑the‑art open model built upon datasets used for Phi‑3 ‑ synthetic data and filtered publicly available websites ‑ with a focus on very high‑quality, reasoning dense data. The model belongs to the Phi‑3 model family and supports 128K token context length. The model underwent a rigorous enhancement process, incorporating both supervised fine‑tuning, proximal policy optimization, and direct preference optimization to ensure precise instruction adherence and robust safety measures.

Not supported

This model is currently not supported on any All Models chipset.

To see performance metrics for this model on other chipsets, click the button below.

View for other chipsets

Technical Details

Context lengths:512, 1024, 2048, 3072, 4096
Input sequence length for Prompt Processor:128
Minimum QAIRT SDK:2.43.1
Number of parameters:3.8B
Quantization Type:w4a16 + w8a16 (few layers)
Response Rate:Rate of response generation after the first response token.

Applicable Scenarios

  • Dialogue
  • Content Generation
  • Customer Support

Supported Form Factors

  • Compute
  • IoT

License

Tags

  • llm
  • generative-ai

Supported Devices

  • Dragonwing IQ-X7181
  • Snapdragon X Elite CRD
  • Snapdragon X Plus 8-Core CRD
  • Snapdragon X2 Elite CRD

Supported Chipsets

  • Qualcomm® Dragonwing™ IQ-X7181
  • Snapdragon® X Elite
  • Snapdragon® X Plus 8-Core
  • Snapdragon® X2 Elite

Looking for more? See models created by industry leaders.

Discover Model Makers