Qualcomm® AI HubAI Hub

Profile Job Results

Jobs
jgo9orjxg
Results Ready
Name
distil_whisper_decoder
Target Device
  • Samsung Galaxy S25
  • Android 15
  • Snapdragon® 8 Elite for Galaxy | SM8750-AC
Creator
ai-hub-support@qti.qualcomm.com
Input Specs
input_ids: int32[1, 1]
attention_mask: float32[1, 1, 1, 200]
k_cache_self_0_in: float32[12, 1, 64, 199]
v_cache_self_0_in: float32[12, 1, 199, 64]
k_cache_self_1_in: float32[12, 1, 64, 199]
v_cache_self_1_in: float32[12, 1, 199, 64]
k_cache_self_2_in: float32[12, 1, 64, 199]
v_cache_self_2_in: float32[12, 1, 199, 64]
k_cache_self_3_in: float32[12, 1, 64, 199]
v_cache_self_3_in: float32[12, 1, 199, 64]
k_cache_cross_0: float32[12, 1, 64, 1500]
v_cache_cross_0: float32[12, 1, 1500, 64]
k_cache_cross_1: float32[12, 1, 64, 1500]
v_cache_cross_1: float32[12, 1, 1500, 64]
k_cache_cross_2: float32[12, 1, 64, 1500]
v_cache_cross_2: float32[12, 1, 1500, 64]
k_cache_cross_3: float32[12, 1, 64, 1500]
v_cache_cross_3: float32[12, 1, 1500, 64]
position_ids: int32[1]
Completion Time
11/15/2026, 4:10:16 PM
Options
--qairt_version latest
Versions
  • Lite RT: 1.4.2
  • QAIRT: v2.51.0.260929181845
  • QNN TfLite Delegate: v2.51.0.260929181845
  • Android: 15 (AP3A.240905.015.A2)
  • AI Hub: aihub-2026.11.06.1
Estimated Inference Time
7.15 ms
Estimated Peak Memory Usage
4 ‑ 368 MB
Compute Units
NPU
1080
StageTimeMemory
First App Load
5.51 s517‑526 MB
Subsequent App Load
228 ms265‑620 MB
Inference
7.15 ms4‑368 MB
Lite RTValue
number_of_threads4
QNN DelegateValue
backend_typekHtpBackend
log_levelkLogLevelWarn
htp_options.performance_modekHtpBurst
htp_options.precisionkHtpFp16
htp_options.optimization_strategykHtpOptimizeForInferenceO3
htp_options.useConvHmxtrue

Sign up to run this model on a hosted Qualcomm® device!

Run on device