Qualcomm® AI HubAI Hub

Profile Job Results

Jobs
j5q6z00op
Results Ready
Name
whisper_base_en_WhisperDecoder
Target Device
  • Snapdragon 8 Elite QRD
  • Android 15
  • Snapdragon® 8 Elite | SM8750
Creator
ai-hub-support@qti.qualcomm.com
Target Model
Input Specs
x: int32[1, 1]
index: int32[1, 1]
k_cache_cross: float32[6, 8, 64, 1500]
v_cache_cross: float32[6, 8, 1500, 64]
k_cache_self: float32[6, 8, 64, 224]
v_cache_self: float32[6, 8, 224, 64]
Completion Time
11/26/2024, 10:02:10 AM
Versions
  • QNN: v2.28.2.241116104011_103376
  • QNN Backend API: 5.28.0
  • QNN Core API: 2.21.0
  • Android: 15 (AQ3A.240829.003)
  • Build ID: Pakala.LA.1.0.r1-01032-STD.PROD-1
  • AI Hub: aihub-2024.11.22.0
Estimated Inference Time
2.56 ms
Estimated Peak Memory Usage
20 ‑ 69 MB
Compute Units
NPU
821
StageTimeMemory
First App Load
2.27 s793‑801 MB
Subsequent App Load
2.31 s742‑961 MB
Inference
2.56 ms20‑69 MB
QNNValue
context_options.htp_options.performance_modeBURST
default_graph_options.htp_options.precisionFLOAT16

Sign up to run this model on a hosted Qualcomm® device!

Run on device