Qualcomm® AI HubAI Hub

Profile Job Results

Jobs
j5qmeo67g
Results Ready
Name
grootn15_llm
Target Device
  • Snapdragon X2 Elite CRD
  • Windows 11
  • Snapdragon® X2 Elite | SC8480XP
Creator
ai-hub-support@qti.qualcomm.com
Input Specs
input_embeds: float32[1, 384, 2048]
llm_attention_mask: float32[1, 1, 384, 384]
Completion Time
7/4/2026, 12:58:47 PM
Versions
  • ONNX Runtime: 1.26.0
  • QAIRT: v2.45.0.260326154327
  • Windows: Windows 11 (28000)
  • Build ID: APSS.WP_GL.1.0.r0-05000-SC8480XRELSFNWZA-4
  • AI Hub: aihub-2026.06.19.2
Estimated Inference Time
49.9 ms
Estimated Peak Memory Usage
8 MB
Compute Units
NPU
724
StageTimeMemory
First App Load
613 ms28 MB
Subsequent App Load
419 ms28 MB
Inference
49.9 ms8 MB
ONNX RuntimeValue
execution_modeSEQUENTIAL
intra_op_num_threads0
inter_op_num_threads0
enable_memory_patternfalse
enable_cpu_memory_arenafalse
graph_optimization_levelENABLE_ALL
QNN Execution ProviderValue
htp_performance_mode"burst"
htp_graph_finalization_optimization_mode"3"
enable_htp_fp16_precision"1"
capture_network_visualizationsfalse
context_priority"normal"
offload_graph_io_quantization"1"

Sign up to run this model on a hosted Qualcomm® device!

Run on device