List your company
ResearchFormerly WizWand

Text Question Answering on NQ (Accuracy)

80.8AccuracyText
31.08843.99456.969.806May 7, 2026
Updated 5mo ago

Evaluation results

MethodLinks
TextICR=1×, ECR=1.0×2026.0580.8
BGE-M3ICR=5×, ECR=4.5×2026.0576.5
LensVLMICR=5×, ECR=4.3×2026.0576.1
LensVLMICR=10×, ECR=7.4×2026.0575.1
Jina-v4ICR=5×, ECR=4.5×2026.0574.8
Qwen3-EmbICR=5×, ECR=4.5×2026.0573.7
BM25ICR=5×, ECR=4.5×2026.0573
BGE-M3ICR=10×, ECR=8.3×2026.0572.2
Jina-v4-MMICR=10×, ECR=8.3×2026.0572
LensVLMICR=15×, ECR=10.1×2026.0571.2
Jina-v4-MMICR=15×, ECR=11.9×2026.0571
Jina-v4ICR=10×, ECR=8.3×2026.0570
BGE-M3ICR=15×, ECR=11.9×2026.0569.7
Jina-v4-MMICR=5×, ECR=4.6×2026.0569.5
Qwen3-EmbICR=10×, ECR=8.3×2026.0569.3
LensVLMSFTICR=5×, ECR=4.6×2026.0568.4
LensVLMSFTICR=10×, ECR=8.1×2026.0567.9
Jina-v4ICR=15×, ECR=11.9×2026.0567.2
BM25ICR=10×, ECR=8.3×2026.0566.8
Qwen3-EmbICR=15×, ECR=11.9×2026.0566
BM25ICR=15×, ECR=11.9×2026.0565.8
ColPaliICR=5×, ECR=4.7×2026.0564.5
ColPaliICR=10×, ECR=8.3×2026.0563
LLMLingua-2ICR=5×, ECR=5.5×2026.0562.2
LensVLMSFTICR=15×, ECR=10.7×2026.0561.6
ColPaliICR=15×, ECR=11.9×2026.0558
GlyphICR=5×, ECR=4.5×2026.0557.5
Base + ExpandICR=5×, ECR=4.5×2026.0555.5
LLMLingua-2ICR=10×, ECR=11.3×2026.0555
Base + ExpandICR=10×, ECR=8.0×2026.0552.5
GlyphICR=15×, ECR=10.8×2026.0550
LLMLingua-2ICR=15×, ECR=15.7×2026.0549.2
Base + ExpandICR=15×, ECR=11.0×2026.0549
GlyphICR=10×, ECR=8.6×2026.0547.5
Comp. ImageICR=5×, ECR=5×2026.0542.5
Comp. ImageICR=15×, ECR=15×2026.0534
Comp. ImageICR=10×, ECR=10×2026.0533