Qualcomm® AI HubAI Hub

Profile Job Results

Jobs
jpy1e9krp
Results Ready
Name
trocr_TrOCRDecoder
Target Device
  • Snapdragon 8 Elite QRD
  • Android 15
  • Snapdragon® 8 Elite | SM8750
Creator
ai-hub-support@qti.qualcomm.com
Target Model
Input Specs
input_ids: int32[1, 1]
index: int32[1]
kv_0_attn_key: float32[1, 8, 19, 32]
kv_0_attn_val: float32[1, 8, 19, 32]
kv_0_cross_attn_key: float32[1, 8, 578, 32]
kv_0_cross_attn_val: float32[1, 8, 578, 32]
kv_1_attn_key: float32[1, 8, 19, 32]
kv_1_attn_val: float32[1, 8, 19, 32]
kv_1_cross_attn_key: float32[1, 8, 578, 32]
kv_1_cross_attn_val: float32[1, 8, 578, 32]
kv_2_attn_key: float32[1, 8, 19, 32]
kv_2_attn_val: float32[1, 8, 19, 32]
kv_2_cross_attn_key: float32[1, 8, 578, 32]
kv_2_cross_attn_val: float32[1, 8, 578, 32]
kv_3_attn_key: float32[1, 8, 19, 32]
kv_3_attn_val: float32[1, 8, 19, 32]
kv_3_cross_attn_key: float32[1, 8, 578, 32]
kv_3_cross_attn_val: float32[1, 8, 578, 32]
kv_4_attn_key: float32[1, 8, 19, 32]
kv_4_attn_val: float32[1, 8, 19, 32]
kv_4_cross_attn_key: float32[1, 8, 578, 32]
kv_4_cross_attn_val: float32[1, 8, 578, 32]
kv_5_attn_key: float32[1, 8, 19, 32]
kv_5_attn_val: float32[1, 8, 19, 32]
kv_5_cross_attn_key: float32[1, 8, 578, 32]
kv_5_cross_attn_val: float32[1, 8, 578, 32]
Completion Time
1/21/2025, 10:15:57 AM
Versions
  • ONNX Runtime: 1.20.1
  • QNN: v2.28.2.241116104011_103376
  • Android: 15 (AQ3A.241126.002)
  • Build ID: Pakala.LA.1.0.r1-01152-STD.PROD-1
  • AI Hub: aihub-2025.01.04.0
Estimated Inference Time
1.73 ms
Estimated Peak Memory Usage
1 ‑ 48 MB
Compute Units
NPU
395
StageTimeMemory
First App Load
3.32 s1 GB
Subsequent App Load
3.40 s1 GB
Inference
1.73 ms1‑48 MB
ONNX RuntimeValue
execution_modeSEQUENTIAL
intra_op_num_threads0
inter_op_num_threads0
enable_memory_patternfalse
enable_cpu_memory_arenafalse
graph_optimization_levelENABLE_ALL
QNN Execution ProviderValue
htp_performance_mode"burst"
htp_graph_finalization_optimization_mode"3"
enable_htp_fp16_precision"1"

Sign up to run this model on a hosted Qualcomm® device!

Run on device