List your company
ResearchFormerly WizWand

Text Question Answering on Qasper

61.3AccuracyText
0.4616.25532.0547.845May 7, 2026
Updated 5mo ago

Evaluation results

MethodLinks
TextICR=1×, ECR=1.0×2026.0561.3
Qwen3-EmbICR=5×, ECR=4.5×2026.0552.2
Jina-v4ICR=5×, ECR=4.5×2026.0550.9
LensVLMICR=5×, ECR=4.3×2026.0548.3
Jina-v4-MMICR=5×, ECR=4.6×2026.0547.3
BGE-M3ICR=5×, ECR=4.5×2026.0545.8
LensVLMSFTICR=5×, ECR=4.6×2026.0543.3
BM25ICR=5×, ECR=4.5×2026.0542.7
Jina-v4-MMICR=10×, ECR=8.3×2026.0539
LensVLMICR=10×, ECR=7.4×2026.0538.5
Base + ExpandICR=5×, ECR=4.5×2026.0537.9
Qwen3-EmbICR=10×, ECR=8.3×2026.0536.3
Jina-v4ICR=10×, ECR=8.3×2026.0536.1
LensVLMSFTICR=10×, ECR=8.1×2026.0536
ColPaliICR=5×, ECR=4.7×2026.0535.8
BGE-M3ICR=10×, ECR=8.3×2026.0534.6
BM25ICR=10×, ECR=8.3×2026.0533.9
LLMLingua-2ICR=5×, ECR=5.5×2026.0533.5
Jina-v4-MMICR=15×, ECR=11.9×2026.0533.5
Qwen3-EmbICR=15×, ECR=11.9×2026.0533.2
GlyphICR=5×, ECR=4.5×2026.0531.9
ColPaliICR=10×, ECR=8.3×2026.0531.9
BGE-M3ICR=15×, ECR=11.9×2026.0531.1
Jina-v4ICR=15×, ECR=11.9×2026.0531
BM25ICR=15×, ECR=11.9×2026.0530.4
LensVLMICR=15×, ECR=10.1×2026.0528.4
Comp. ImageICR=5×, ECR=5×2026.0525.3
Base + ExpandICR=10×, ECR=8.0×2026.0525.3
LLMLingua-2ICR=10×, ECR=11.3×2026.0524.5
LensVLMSFTICR=15×, ECR=10.7×2026.0524.4
ColPaliICR=15×, ECR=11.9×2026.0521.4
LLMLingua-2ICR=15×, ECR=15.7×2026.0516.8
Base + ExpandICR=15×, ECR=11.0×2026.0515.4
GlyphICR=10×, ECR=8.6×2026.0512.1
Comp. ImageICR=10×, ECR=10×2026.058.8
GlyphICR=15×, ECR=10.8×2026.057.7
Comp. ImageICR=15×, ECR=15×2026.052.8