Qualcomm® AI HubAI Hub

Profile Job Results

Jobs
jgo2yjmkp
Results Ready
Name
whisper_small_en_WhisperDecoder
Target Device
  • SA7255P ADP
  • Android 14
  • Qualcomm® SA7255P
Creator
ai-hub-support@qti.qualcomm.com
Target Model
Input Specs
x: int32[1, 1]
index: int32[1, 1]
k_cache_cross: float32[12, 12, 64, 1500]
v_cache_cross: float32[12, 12, 1500, 64]
k_cache_self: float32[12, 12, 64, 224]
v_cache_self: float32[12, 12, 224, 64]
Completion Time
1/21/2025, 9:59:16 AM
Versions
  • TensorFlow Lite: 2.17.0
  • QNN TfLite Delegate: v2.28.0.241029232508_102474-auto
  • Android: 14 (UQ1A.240205.002)
  • Build ID: Snapdragon_Auto.HQX.4.5.6.0.r2-00012-STD.PROD-5
  • AI Hub: aihub-2025.01.04.0
Estimated Inference Time
101 ms
Estimated Peak Memory Usage
16 ‑ 175 MB
Compute Units
NPU
2573
StageTimeMemory
First App Load
1.30 min3 GB
Subsequent App Load
1.35 min3‑4 GB
Inference
101 ms16‑175 MB
TensorFlow LiteValue
number_of_threads4
QNN DelegateValue
backend_typekHtpBackend
log_levelkLogLevelWarn
htp_options.precisionkHtpFp16
htp_options.useConvHmxtrue

Sign up to run this model on a hosted Qualcomm® device!

Run on device