Qualcomm® AI HubAI Hub

Profile Job Results

Jobs
jg90d12lg
Results Ready
Name
trocr_TrOCRDecoder
Target Device
  • Snapdragon 8 Elite QRD
  • Android 15
  • Snapdragon® 8 Elite | SM8750
Creator
ai-hub-support@qti.qualcomm.com
Target Model
Input Specs
input_ids: int32[1, 1]
index: int32[1]
kv_0_attn_key: float32[1, 8, 19, 32]
kv_0_attn_val: float32[1, 8, 19, 32]
kv_0_cross_attn_key: float32[1, 8, 578, 32]
kv_0_cross_attn_val: float32[1, 8, 578, 32]
kv_1_attn_key: float32[1, 8, 19, 32]
kv_1_attn_val: float32[1, 8, 19, 32]
kv_1_cross_attn_key: float32[1, 8, 578, 32]
kv_1_cross_attn_val: float32[1, 8, 578, 32]
kv_2_attn_key: float32[1, 8, 19, 32]
kv_2_attn_val: float32[1, 8, 19, 32]
kv_2_cross_attn_key: float32[1, 8, 578, 32]
kv_2_cross_attn_val: float32[1, 8, 578, 32]
kv_3_attn_key: float32[1, 8, 19, 32]
kv_3_attn_val: float32[1, 8, 19, 32]
kv_3_cross_attn_key: float32[1, 8, 578, 32]
kv_3_cross_attn_val: float32[1, 8, 578, 32]
kv_4_attn_key: float32[1, 8, 19, 32]
kv_4_attn_val: float32[1, 8, 19, 32]
kv_4_cross_attn_key: float32[1, 8, 578, 32]
kv_4_cross_attn_val: float32[1, 8, 578, 32]
kv_5_attn_key: float32[1, 8, 19, 32]
kv_5_attn_val: float32[1, 8, 19, 32]
kv_5_cross_attn_key: float32[1, 8, 578, 32]
kv_5_cross_attn_val: float32[1, 8, 578, 32]
Completion Time
3/11/2025, 1:26:47 PM
Versions
  • ONNX Runtime: 1.20.1
  • QAIRT: v2.32.0.250228225014_116386
  • Android: 15 (AQ3A.241126.002)
  • Build ID: Pakala.LA.1.0.r1-01152-STD.PROD-1
  • AI Hub: aihub-2025.03.06.0
Estimated Inference Time
1.76 ms
Estimated Peak Memory Usage
3 ‑ 69 MB
Compute Units
NPU
395
StageTimeMemory
First App Load
2.76 s741‑748 MB
Subsequent App Load
2.71 s690‑805 MB
Inference
1.76 ms3‑69 MB
ONNX RuntimeValue
execution_modeSEQUENTIAL
intra_op_num_threads0
inter_op_num_threads0
enable_memory_patternfalse
enable_cpu_memory_arenafalse
graph_optimization_levelENABLE_ALL
QNN Execution ProviderValue
htp_performance_mode"burst"
htp_graph_finalization_optimization_mode"3"
enable_htp_fp16_precision"1"

Sign up to run this model on a hosted Qualcomm® device!

Run on device