Qualcomm® AI HubAI Hub
HomeAppsLLM Chat Windows

LLM Chat Windows

Deploy and run LLMs via CLI

A sample CLI app demonstrating how to integrate an on‑device LLM with Qualcomm® Gen AI Inference Extensions (Genie) APIs, optimized for Snapdragon® NPU acceleration.

App ReadMeDiscuss on Slack
1. Choose a compatible model
2. Get source code and dependencies
3. Build and run app

Compatible Models

View details for the Llama-v2-7B-Chat model.

Llama-v2-7B-Chat

View details for the Llama-v3-8B-Instruct model.

Llama-v3-8B-Instruct

View details for the Llama-v3.1-8B-Instruct model.

Llama-v3.1-8B-Instruct

View details for the Llama-v3.2-3B-Instruct model.

Llama-v3.2-3B-Instruct

View details for the Llama3-TAIDE-LX-8B-Chat-Alpha1 model.

Llama3-TAIDE-LX-8B-Chat-Alpha1

App Information

Operating System

Windows 11+

Language

C++

Runtime

Qualcomm® Gen AI Inference Extensions (Genie)

Use Case

Text Generation

Join us on Slack

Join our growing community of 2000+ developers in the AI Hub Slack Channel building the future of AI
Join Now