List your company

Multimodal Autocomplete on ImageChat (unseen prefixes)

0.281PR-F1Router-4-Max (Oracle)
0.076640.1296950.182750.235805Jan 9, 2026

Evaluation results

MethodLinks
Router-4-Max (Oracle)Router configuration=Router-4, Oracle=true2026.010.2810.09——————
MiniCPM-VType=VLMs2026.010.25860.0715—0.98920.31280.220516.10.1246
Qwen2-VLType=VLMs2026.010.23560.0577—0.98890.29310.197116.20.1422
PaliGemmaType=VLMs2026.010.23480.0616—0.98810.2850.199616.70.1148
MiniCPM-VModel=Individual Model, Inference engine=vLLM2026.010.2230.0672.08—————
Router-4-LRouter configuration=Router-4, Optimization goal=L (Minimum latency), Inference engine=vLLM2026.010.2120.0560.966—————
Router-4-PRouter configuration=Router-4, Optimization goal=P (Maximum performance), Inference engine=vLLM2026.010.2120.0560.966—————
PaliGemmaModel=Individual Model, Inference engine=vLLM2026.010.1990.0571.49—————
Qwen2-VLModel=Individual Model, Inference engine=vLLM2026.010.1970.0530.733—————
Router-2-LRouter configuration=Router-2, Optimization goal=L (Minimum latency), Inference engine=vLLM2026.010.1960.0530.288—————
Router-2-PRouter configuration=Router-2, Optimization goal=P (Maximum performance), Inference engine=vLLM2026.010.1960.0530.288—————
QBType=Textual2026.010.17550.0373—0.96040.30650.12255.90.0955
MPC++Type=Textual2026.010.15230.0341—0.67280.2080.120217.30.0371
QBModel=Individual Model, Inference engine=vLLM2026.010.1350.0360.001—————
MPCType=Textual2026.010.08450.0007—0.27490.1120.068527.70.003