Profile Job Results
Jobs
jpr0znqvp
Results Ready
Name
grootn15_llm
Target Device
- Arduino VENTUNO Q
- Ubuntu 24.04
- Qualcomm® Dragonwing™ IQ-8275 | QCS8275
Creator
ai-hub-support@qti.qualcomm.com
Input Specs
input_embeds: float32[1, 384, 2048]llm_attention_mask: float32[1, 1, 384, 384]Completion Time
9/5/2026, 9:28:58 AM
Versions
- QAIRT: v2.45.0.260326154327
- QNN Backend API: 5.45.0
- QNN Core API: 2.34.0
- Qualcomm Linux: 24.04
- AI Hub: aihub-2026.08.28.1
Estimated Inference Time
132 ms
Estimated Peak Memory Usage
4 ‑ 12 MB
Compute Units
NPU
712
| Stage | Time | Memory |
|---|---|---|
First App Load | 543 ms | 2 MB |
Subsequent App Load | 538 ms | 2 MB |
Inference | 132 ms | 4‑12 MB |
| QNN | Value |
|---|---|
| context_options.htp_options.performance_mode | BURST |
| default_graph_options.htp_options.optimizations[0].type | FINALIZE_OPTIMIZATION_FLAG |
| default_graph_options.htp_options.optimizations[0].value | 3.0 |
| default_graph_options.htp_options.precision | FLOAT16 |
| default_graph_options.htp_options.vtcm_size | 0 |
Sign up to run this model on a hosted Qualcomm® device!
Run on device