Qualcomm® AI HubAI Hub

Profile Job Results

Jobs
jg9z8zj8p
Results Ready
Name
distil_whisper_decoder
Target Device
  • Samsung Galaxy S22 5G
  • Android 12
  • Snapdragon® 8 Gen 1 | SM8450
Creator
ai-hub-support@qti.qualcomm.com
Input Specs
input_ids: int32[1, 1]
attention_mask: float32[1, 1, 1, 200]
k_cache_self_0_in: float32[12, 1, 64, 199]
v_cache_self_0_in: float32[12, 1, 199, 64]
k_cache_self_1_in: float32[12, 1, 64, 199]
v_cache_self_1_in: float32[12, 1, 199, 64]
k_cache_self_2_in: float32[12, 1, 64, 199]
v_cache_self_2_in: float32[12, 1, 199, 64]
k_cache_self_3_in: float32[12, 1, 64, 199]
v_cache_self_3_in: float32[12, 1, 199, 64]
k_cache_cross_0: float32[12, 1, 64, 1500]
v_cache_cross_0: float32[12, 1, 1500, 64]
k_cache_cross_1: float32[12, 1, 64, 1500]
v_cache_cross_1: float32[12, 1, 1500, 64]
k_cache_cross_2: float32[12, 1, 64, 1500]
v_cache_cross_2: float32[12, 1, 1500, 64]
k_cache_cross_3: float32[12, 1, 64, 1500]
v_cache_cross_3: float32[12, 1, 1500, 64]
position_ids: int32[1]
Completion Time
9/19/2026, 8:47:15 PM
Options
--qairt_version latest
Versions
  • Lite RT: 1.4.2
  • QAIRT: v2.50.0.260828221209
  • QNN TfLite Delegate: v2.50.0.260828221209
  • Android: 12 (SP1A.210812.016)
  • AI Hub: aihub-2026.09.11.0
Estimated Inference Time
14.0 ms
Estimated Peak Memory Usage
5 ‑ 454 MB
Compute Units
NPU
1080
StageTimeMemory
First App Load
6.18 s791‑798 MB
Subsequent App Load
423 ms218‑668 MB
Inference
14.0 ms5‑454 MB
Lite RTValue
number_of_threads4
QNN DelegateValue
backend_typekHtpBackend
log_levelkLogLevelWarn
htp_options.performance_modekHtpBurst
htp_options.precisionkHtpFp16
htp_options.optimization_strategykHtpOptimizeForInferenceO3
htp_options.useConvHmxtrue

Sign up to run this model on a hosted Qualcomm® device!

Run on device