Qualcomm® AI HubAI Hub

Profile Job Results

Jobs
jgj8o6675
Results Ready
Name
trocr_decoder
Target Device
  • Snapdragon 8 Elite Gen 6 QRD
  • Android 17
  • Snapdragon® 8 Elite Gen 6 | SM8950
Creator
ai-hub-support@qti.qualcomm.com
Input Specs
input_ids: int32[1, 1]
index: int32[1]
kv_0_attn_key: float32[1, 8, 19, 32]
kv_0_attn_val: float32[1, 8, 19, 32]
kv_0_cross_attn_key: float32[1, 8, 578, 32]
kv_0_cross_attn_val: float32[1, 8, 578, 32]
kv_1_attn_key: float32[1, 8, 19, 32]
kv_1_attn_val: float32[1, 8, 19, 32]
kv_1_cross_attn_key: float32[1, 8, 578, 32]
kv_1_cross_attn_val: float32[1, 8, 578, 32]
kv_2_attn_key: float32[1, 8, 19, 32]
kv_2_attn_val: float32[1, 8, 19, 32]
kv_2_cross_attn_key: float32[1, 8, 578, 32]
kv_2_cross_attn_val: float32[1, 8, 578, 32]
kv_3_attn_key: float32[1, 8, 19, 32]
kv_3_attn_val: float32[1, 8, 19, 32]
kv_3_cross_attn_key: float32[1, 8, 578, 32]
kv_3_cross_attn_val: float32[1, 8, 578, 32]
kv_4_attn_key: float32[1, 8, 19, 32]
kv_4_attn_val: float32[1, 8, 19, 32]
kv_4_cross_attn_key: float32[1, 8, 578, 32]
kv_4_cross_attn_val: float32[1, 8, 578, 32]
kv_5_attn_key: float32[1, 8, 19, 32]
kv_5_attn_val: float32[1, 8, 19, 32]
kv_5_cross_attn_key: float32[1, 8, 578, 32]
kv_5_cross_attn_val: float32[1, 8, 578, 32]
Completion Time
11/15/2026, 7:46:58 PM
Options
--qairt_version latest
Versions
  • Lite RT: 1.4.2
  • QAIRT: v2.51.0.260929181845
  • QNN TfLite Delegate: v2.51.0.260929181845
  • Android: 17 (CQ2A.260820.002-CP2A.260605.016)
  • Build ID: Maili.LA.1.0.r1-00252-STD.PROD-1
  • AI Hub: aihub-2026.11.06.1
Estimated Inference Time
1.31 ms
Estimated Peak Memory Usage
0 ‑ 107 MB
Compute Units
NPU
386
StageTimeMemory
First App Load
1.89 s272‑282 MB
Subsequent App Load
131 ms74‑181 MB
Inference
1.31 ms0‑107 MB
Lite RTValue
number_of_threads4
QNN DelegateValue
backend_typekHtpBackend
log_levelkLogLevelWarn
htp_options.performance_modekHtpBurst
htp_options.precisionkHtpFp16
htp_options.optimization_strategykHtpOptimizeForInferenceO3
htp_options.useConvHmxtrue

Sign up to run this model on a hosted Qualcomm® device!

Run on device