Qualcomm® AI HubAI Hub

Allam-7B

Large Language Model supporting arabic and english.

Allam 7B is SDAIA's first generation edge model, optimized for performance on Snapdragon X Elite.

Coming Soon
Model RepositoryHugging Face

Technical Details

Input sequence length for Prompt Processor:128
Max context length:1024
Num of key-value heads:32
Number of parameters:7B
Precision:w4a16 + w8a16 (few layers)
Use:Initiate conversation with prompt-processor and then token generator for subsequent iterations.
Minimum QNN SDK version required:2.28.2
Supported languages:English, Arabic.
TTFT:Time To First Token is the time it takes to generate the first response token. This is expressed as a range because it varies based on the length of the prompt. The lower bound is for a short prompt (up to 128 tokens, i.e., one iteration of the prompt processor) and the upper bound is for a prompt using the full context length (4096 tokens).
Response Rate:Rate of response generation after the first response token.

Applicable Scenarios

  • Dialogue
  • Content Generation
  • Customer Support

Licenses

Terms of Use:Qualcomm® Generative AI usage and limitations

Tags

  • llm
  • generative-ai
  • quantized

Supported Compute Devices

  • Snapdragon X Elite CRD

Supported Compute Chipsets

  • Snapdragon® X Elite

Looking for more? See models created by industry leaders.

Discover Model Makers