List your company
ResearchFormerly WizWand

Text Question Answering on MuSiQue (Accuracy)

69.6AccuracyLensVLM
10.21625.63341.0556.467May 7, 2026
Updated 5mo ago

Evaluation results

MethodLinks
LensVLMICR=5×, ECR=4.3×2026.0569.6
TextICR=1×, ECR=1.0×2026.0568.7
LensVLMSFTICR=5×, ECR=4.6×2026.0566.1
LensVLMICR=10×, ECR=7.4×2026.0562.4
LensVLMSFTICR=10×, ECR=8.1×2026.0559.9
BGE-M3ICR=5×, ECR=4.5×2026.0559
Jina-v4-MMICR=5×, ECR=4.6×2026.0558.5
Jina-v4ICR=5×, ECR=4.5×2026.0557.5
Qwen3-EmbICR=5×, ECR=4.5×2026.0556.5
BM25ICR=5×, ECR=4.5×2026.0553.2
ColPaliICR=5×, ECR=4.7×2026.0549.5
LensVLMICR=15×, ECR=10.1×2026.0549
Qwen3-EmbICR=10×, ECR=8.3×2026.0548.2
BGE-M3ICR=10×, ECR=8.3×2026.0548
Jina-v4ICR=10×, ECR=8.3×2026.0547.7
Jina-v4-MMICR=10×, ECR=8.3×2026.0545
BM25ICR=10×, ECR=8.3×2026.0543.8
Jina-v4ICR=15×, ECR=11.9×2026.0541.7
Qwen3-EmbICR=15×, ECR=11.9×2026.0541.3
LensVLMSFTICR=15×, ECR=10.7×2026.0541.2
BGE-M3ICR=15×, ECR=11.9×2026.0540.2
Jina-v4-MMICR=15×, ECR=11.9×2026.0539
BM25ICR=15×, ECR=11.9×2026.0536.8
Base + ExpandICR=5×, ECR=4.5×2026.0534
LLMLingua-2ICR=5×, ECR=5.5×2026.0533.8
GlyphICR=5×, ECR=4.5×2026.0533
ColPaliICR=10×, ECR=8.3×2026.0532.5
ColPaliICR=15×, ECR=11.9×2026.0531.5
GlyphICR=10×, ECR=8.6×2026.0526.5
LLMLingua-2ICR=10×, ECR=11.3×2026.0526.5
LLMLingua-2ICR=15×, ECR=15.7×2026.0521.8
GlyphICR=15×, ECR=10.8×2026.0521
Comp. ImageICR=5×, ECR=5×2026.0519.5
Base + ExpandICR=10×, ECR=8.0×2026.0515
Comp. ImageICR=10×, ECR=10×2026.0514
Comp. ImageICR=15×, ECR=15×2026.0512.5
Base + ExpandICR=15×, ECR=11.0×2026.0512.5