Qualcomm® AI HubAI Hub

Profile Job Results

Jobs
jgz08m1k5
Results Ready
Name
distil_whisper_decoder
Target Device
  • Snapdragon 8 Elite Gen 6 QRD
  • Android 17
  • Snapdragon® 8 Elite Gen 6 | SM8950
Creator
ai-hub-support@qti.qualcomm.com
Input Specs
input_ids: int32[1, 1]
attention_mask: float32[1, 1, 1, 200]
k_cache_self_0_in: float32[12, 1, 64, 199]
v_cache_self_0_in: float32[12, 1, 199, 64]
k_cache_self_1_in: float32[12, 1, 64, 199]
v_cache_self_1_in: float32[12, 1, 199, 64]
k_cache_self_2_in: float32[12, 1, 64, 199]
v_cache_self_2_in: float32[12, 1, 199, 64]
k_cache_self_3_in: float32[12, 1, 64, 199]
v_cache_self_3_in: float32[12, 1, 199, 64]
k_cache_cross_0: float32[12, 1, 64, 1500]
v_cache_cross_0: float32[12, 1, 1500, 64]
k_cache_cross_1: float32[12, 1, 64, 1500]
v_cache_cross_1: float32[12, 1, 1500, 64]
k_cache_cross_2: float32[12, 1, 64, 1500]
v_cache_cross_2: float32[12, 1, 1500, 64]
k_cache_cross_3: float32[12, 1, 64, 1500]
v_cache_cross_3: float32[12, 1, 1500, 64]
position_ids: int32[1]
Completion Time
11/15/2026, 4:13:00 PM
Options
--qairt_version latest
Versions
  • Lite RT: 1.4.2
  • QAIRT: v2.51.0.260929181845
  • QNN TfLite Delegate: v2.51.0.260929181845
  • Android: 17 (CQ2A.260820.002-CP2A.260605.016)
  • Build ID: Maili.LA.1.0.r1-00252-STD.PROD-1
  • AI Hub: aihub-2026.11.06.1
Estimated Inference Time
6.49 ms
Estimated Peak Memory Usage
4 ‑ 351 MB
Compute Units
NPU
1080
StageTimeMemory
First App Load
4.54 s606‑616 MB
Subsequent App Load
182 ms218‑567 MB
Inference
6.49 ms4‑351 MB
Lite RTValue
number_of_threads4
QNN DelegateValue
backend_typekHtpBackend
log_levelkLogLevelWarn
htp_options.performance_modekHtpBurst
htp_options.precisionkHtpFp16
htp_options.optimization_strategykHtpOptimizeForInferenceO3
htp_options.useConvHmxtrue

Sign up to run this model on a hosted Qualcomm® device!

Run on device