Qualcomm® AI HubAI Hub

Profile Job Results

Jobs
jgo9or0xg
Results Ready
Name
distil_whisper_decoder
Target Device
  • Arduino VENTUNO Q
  • Ubuntu 24.04
  • Qualcomm® Dragonwing™ IQ-8275 | QCS8275
Creator
ai-hub-support@qti.qualcomm.com
Input Specs
input_ids: int32[1, 1]
position_ids: int32[1]
k_cache_self_0_in: float32[12, 1, 64, 199]
attention_mask: float32[1, 1, 1, 200]
v_cache_self_0_in: float32[12, 1, 199, 64]
k_cache_cross_0: float32[12, 1, 64, 1500]
v_cache_cross_0: float32[12, 1, 1500, 64]
k_cache_self_1_in: float32[12, 1, 64, 199]
v_cache_self_1_in: float32[12, 1, 199, 64]
k_cache_cross_1: float32[12, 1, 64, 1500]
v_cache_cross_1: float32[12, 1, 1500, 64]
k_cache_self_2_in: float32[12, 1, 64, 199]
v_cache_self_2_in: float32[12, 1, 199, 64]
k_cache_cross_2: float32[12, 1, 64, 1500]
v_cache_cross_2: float32[12, 1, 1500, 64]
k_cache_self_3_in: float32[12, 1, 64, 199]
v_cache_self_3_in: float32[12, 1, 199, 64]
k_cache_cross_3: float32[12, 1, 64, 1500]
v_cache_cross_3: float32[12, 1, 1500, 64]
Completion Time
11/15/2026, 4:17:43 PM
Options
--qairt_version latest
Versions
  • QAIRT: v2.51.0.260929181845
  • QNN Backend API: 5.51.0
  • QNN Core API: 2.40.0
  • Qualcomm Linux: 24.04
  • AI Hub: aihub-2026.11.06.1
Estimated Inference Time
12.4 ms
Estimated Peak Memory Usage
40 ‑ 88 MB
Compute Units
NPU
811
StageTimeMemory
First App Load
16.3 s838‑839 MB
Subsequent App Load
314 ms2‑3 MB
Inference
12.4 ms40‑88 MB
QNNValue
context_options.htp_options.performance_modeBURST
default_graph_options.htp_options.optimizations[0].typeFINALIZE_OPTIMIZATION_FLAG
default_graph_options.htp_options.optimizations[0].value3.0
default_graph_options.htp_options.precisionFLOAT16
default_graph_options.htp_options.vtcm_size0

Sign up to run this model on a hosted Qualcomm® device!

Run on device