List your company

Multimodal Autocomplete on MMDD unseen prefixes

35.6PR-F1Router-4-Max (Oracle)
6.11613.770521.42529.0795Jan 9, 2026

Evaluation results

MethodLinks
Router-4-Max (Oracle)Router configuration=Router-4, Oracle=true2026.0135.619.5——————
Router-4-PRouter configuration=Router-4, Optimization goal=P (Maximum performance), Inference engine=vLLM2026.0128.113.50.832—————
MiniCPM-VType=VLMs2026.012811.82—98.9833.6224.2321.10.2136
Router-2-PRouter configuration=Router-2, Optimization goal=P (Maximum performance), Inference engine=vLLM2026.0126.112.20.271—————
Qwen2-VLType=VLMs2026.0125.3210.34—98.9129.522.2318.80.1844
MiniCPM-VModel=Individual Model, Inference engine=vLLM2026.0124.711.62.08—————
PaliGemmaType=VLMs2026.0124.79.72—98.828.9621.4520.30.203
Router-4-LRouter configuration=Router-4, Optimization goal=L (Minimum latency), Inference engine=vLLM2026.0124110.351—————
Router-2-LRouter configuration=Router-2, Optimization goal=L (Minimum latency), Inference engine=vLLM2026.012410.90.17—————
Qwen2-VLModel=Individual Model, Inference engine=vLLM2026.0122.210.10.733—————
PaliGemmaModel=Individual Model, Inference engine=vLLM2026.0121.69.71.49—————
QBModel=Individual Model, Inference engine=vLLM2026.0120.910.20.001—————
QBType=Textual2026.0118.924.26—92.234.9812.878.90.1724
MPC++Type=Textual2026.0115.253.32—56.5118.3113.0329.40.043
MPCType=Textual2026.017.250—19.917.826.7640.60.0015