Qualcomm® AI HubAI HubQualcomm® AI HubAI Hub

A “backbone” model is designed to extract task-agnostic representations from specific data modalities (e.g., images, text, speech). This representation can then be fine-tuned for specialized tasks.

A “foundation” model is versatile and designed for multi-task capabilities, without the need for fine-tuning.

Models capable of generating text, images, or other data using generative models, often in response to prompts.

Large language models. Useful for a variety of tasks including language generation, optical character recognition, information retrieval, and more.

A “quantized” model can run in low or mixed precision, which can substantially reduce inference latency.

A “real-time” model can typically achieve 5-60 predictions per second. This translates to latency ranging up to 200 ms per prediction.