Qualcomm® AI HubAI Hub

Profile Job Results

Jobs
jg90d1yqg
Results Ready
Name
whisper_tiny_en_WhisperDecoder
Target Device
  • Snapdragon X Elite CRD
  • Windows 11
  • Snapdragon® X Elite | SC8380XP
Creator
ai-hub-support@qti.qualcomm.com
Target Model
Input Specs
x: int32[1, 1]
index: int32[1, 1]
k_cache_cross: float32[4, 6, 64, 1500]
v_cache_cross: float32[4, 6, 1500, 64]
k_cache_self: float32[4, 6, 64, 224]
v_cache_self: float32[4, 6, 224, 64]
Completion Time
3/11/2025, 12:52:57 PM
Versions
  • ONNX Runtime: 1.20.1
  • QAIRT: v2.32.0.250228225014_116386
  • Windows: Windows 11 (26100)
  • Build ID: APSS.WP_HA.1.0.c90-07350-SC8380XPSRSFNWZA-2
  • AI Hub: aihub-2025.03.06.0
Estimated Inference Time
4.06 ms
Estimated Peak Memory Usage
74 MB
Compute Units
NPU
462
StageTimeMemory
First App Load
13.1 s954 MB
Subsequent App Load
353 ms113 MB
Inference
4.06 ms74 MB
ONNX RuntimeValue
execution_modeSEQUENTIAL
intra_op_num_threads0
inter_op_num_threads0
enable_memory_patternfalse
enable_cpu_memory_arenafalse
graph_optimization_levelENABLE_ALL
QNN Execution ProviderValue
htp_performance_mode"burst"
htp_graph_finalization_optimization_mode"3"
enable_htp_fp16_precision"1"

Sign up to run this model on a hosted Qualcomm® device!

Run on device