Profile Job Results

Jobs
jgdr837lp
Results Ready
Name
distil_whisper_decoder
Target Device
  • Samsung Galaxy S24
  • Android 14
  • Snapdragon® 8 Gen 3 | SM8650
Creator
ai-hub-support@qti.qualcomm.com
Target Model
Input Specs
input_ids: int32[1, 1]
attention_mask: float32[1, 1, 1, 200]
k_cache_self_0_in: float32[12, 1, 64, 199]
v_cache_self_0_in: float32[12, 1, 199, 64]
k_cache_self_1_in: float32[12, 1, 64, 199]
v_cache_self_1_in: float32[12, 1, 199, 64]
k_cache_self_2_in: float32[12, 1, 64, 199]
v_cache_self_2_in: float32[12, 1, 199, 64]
k_cache_self_3_in: float32[12, 1, 64, 199]
v_cache_self_3_in: float32[12, 1, 199, 64]
k_cache_cross_0: float32[12, 1, 64, 1500]
v_cache_cross_0: float32[12, 1, 1500, 64]
k_cache_cross_1: float32[12, 1, 64, 1500]
v_cache_cross_1: float32[12, 1, 1500, 64]
k_cache_cross_2: float32[12, 1, 64, 1500]
v_cache_cross_2: float32[12, 1, 1500, 64]
k_cache_cross_3: float32[12, 1, 64, 1500]
v_cache_cross_3: float32[12, 1, 1500, 64]
position_ids: int32[1]
Completion Time
4/5/2026, 10:32:22 AM
Versions
  • LiteRT: 1.4.2
  • QAIRT: v2.43.0.260127150333_193827
  • QNN TfLite Delegate: v2.43.0.260127150333_193827
  • Android: 14 (UP1A.231005.007)
  • AI Hub: aihub-2026.03.29.0
Estimated Inference Time
8.47 ms
Estimated Peak Memory Usage
4 ‑ 556 MB
Compute Units
NPU
1080
StageTimeMemory
First App Load
8.10 s724‑731 MB
Subsequent App Load
273 ms219‑769 MB
Inference
8.47 ms4‑556 MB
TensorFlow LiteValue
number_of_threads4
QNN DelegateValue
backend_typekHtpBackend
log_levelkLogLevelWarn
htp_options.performance_modekHtpBurst
htp_options.precisionkHtpFp16
htp_options.optimization_strategykHtpOptimizeForInferenceO3
htp_options.useConvHmxtrue

Sign up to run this model on a hosted Qualcomm® device!

Run on device