Qualcomm® AI HubAI Hub

Profile Job Results

Jobs
jg9qkmvlp
Results Ready
Name
distil_whisper_decoder
Target Device
  • Snapdragon 8 Elite Extreme Gen 6 QRD
  • Android 17
  • Snapdragon® 8 Elite Extreme Gen 6 | SM8975
Creator
ai-hub-support@qti.qualcomm.com
Input Specs
input_ids: int32[1, 1]
attention_mask: float32[1, 1, 1, 200]
k_cache_self_0_in: float32[12, 1, 64, 199]
v_cache_self_0_in: float32[12, 1, 199, 64]
k_cache_self_1_in: float32[12, 1, 64, 199]
v_cache_self_1_in: float32[12, 1, 199, 64]
k_cache_self_2_in: float32[12, 1, 64, 199]
v_cache_self_2_in: float32[12, 1, 199, 64]
k_cache_self_3_in: float32[12, 1, 64, 199]
v_cache_self_3_in: float32[12, 1, 199, 64]
k_cache_cross_0: float32[12, 1, 64, 1500]
v_cache_cross_0: float32[12, 1, 1500, 64]
k_cache_cross_1: float32[12, 1, 64, 1500]
v_cache_cross_1: float32[12, 1, 1500, 64]
k_cache_cross_2: float32[12, 1, 64, 1500]
v_cache_cross_2: float32[12, 1, 1500, 64]
k_cache_cross_3: float32[12, 1, 64, 1500]
v_cache_cross_3: float32[12, 1, 1500, 64]
position_ids: int32[1]
Completion Time
11/15/2026, 4:11:20 PM
Options
--qairt_version latest
Versions
  • Lite RT: 1.4.2
  • QAIRT: v2.51.0.260929181845
  • QNN TfLite Delegate: v2.51.0.260929181845
  • Android: 17 (CQ2A.260820.002-CP2A.260605.016)
  • Build ID: Hawi.LA.1.0.r1-01035-STD.PROD-1
  • AI Hub: aihub-2026.11.06.1
Estimated Inference Time
5.30 ms
Estimated Peak Memory Usage
4 ‑ 368 MB
Compute Units
NPU
1080
StageTimeMemory
First App Load
7.12 s576‑586 MB
Subsequent App Load
192 ms221‑587 MB
Inference
5.30 ms4‑368 MB
Lite RTValue
number_of_threads4
QNN DelegateValue
backend_typekHtpBackend
log_levelkLogLevelWarn
htp_options.performance_modekHtpBurst
htp_options.precisionkHtpFp16
htp_options.optimization_strategykHtpOptimizeForInferenceO3
htp_options.useConvHmxtrue

Sign up to run this model on a hosted Qualcomm® device!

Run on device