Qualcomm® AI HubAI Hub

Profile Job Results

Jobs
jpe723v15
Results Ready
Name
grootn15_llm
Target Device
  • Snapdragon X Elite CRD
  • Windows 11
  • Snapdragon® X Elite | SC8380XP
Creator
ai-hub-support@qti.qualcomm.com
Input Specs
input_embeds: float32[1, 384, 2048]
llm_attention_mask: float32[1, 1, 384, 384]
Completion Time
9/20/2026, 4:26:13 AM
Options
--qairt_version latest
Versions
  • ONNX Runtime: 1.27.1
  • QAIRT: v2.50.0.260828221209
  • Windows: Windows 11 (26200)
  • Build ID: APSS.WP_HA.1.0-09400-SC8380XRELSFNWZA-8
  • AI Hub: aihub-2026.09.11.0
Estimated Inference Time
54.1 ms
Estimated Peak Memory Usage
600 MB
Compute Units
NPU
738
StageTimeMemory
First App Load
1.17 s626 MB
Subsequent App Load
925 ms626 MB
Inference
54.1 ms600 MB
ONNX RuntimeValue
execution_modeSEQUENTIAL
intra_op_num_threads0
inter_op_num_threads0
enable_memory_patternfalse
enable_cpu_memory_arenafalse
graph_optimization_levelENABLE_ALL
QNN Execution ProviderValue
htp_performance_mode"burst"
htp_graph_finalization_optimization_mode"3"
enable_htp_fp16_precision"1"
capture_network_visualizationsfalse
context_priority"normal"
offload_graph_io_quantization"1"

Sign up to run this model on a hosted Qualcomm® device!

Run on device