List your company
ResearchFormerly WizWand

Text Question Answering on RULER

70.7AccuracyText
13.91628.65843.458.142May 7, 2026
Updated 5mo ago

Evaluation results

MethodLinks
TextICR=1×, ECR=1.0×2026.0570.7
Jina-v4-MMICR=5×, ECR=4.6×2026.0568.4
BM25ICR=5×, ECR=4.5×2026.0567.4
BGE-M3ICR=5×, ECR=4.5×2026.0567
Jina-v4ICR=5×, ECR=4.5×2026.0566.9
Qwen3-EmbICR=5×, ECR=4.5×2026.0566.9
BM25ICR=10×, ECR=8.3×2026.0565.7
LensVLMICR=5×, ECR=4.3×2026.0565.5
Jina-v4ICR=10×, ECR=8.3×2026.0565.3
GlyphICR=5×, ECR=4.5×2026.0564.9
BGE-M3ICR=10×, ECR=8.3×2026.0563.4
LensVLMICR=10×, ECR=7.4×2026.0560.8
LensVLMSFTICR=5×, ECR=4.6×2026.0560.7
Qwen3-EmbICR=10×, ECR=8.3×2026.0560.3
GlyphICR=10×, ECR=8.6×2026.0558.6
ColPaliICR=5×, ECR=4.7×2026.0556.6
LLMLingua-2ICR=5×, ECR=5.5×2026.0556.1
LensVLMSFTICR=10×, ECR=8.1×2026.0555.1
GlyphICR=15×, ECR=10.8×2026.0554.8
BM25ICR=15×, ECR=11.9×2026.0554.5
Jina-v4ICR=15×, ECR=11.9×2026.0553.6
LensVLMICR=15×, ECR=10.1×2026.0552.7
BGE-M3ICR=15×, ECR=11.9×2026.0551.3
Jina-v4-MMICR=10×, ECR=8.3×2026.0551.1
Qwen3-EmbICR=15×, ECR=11.9×2026.0549.8
ColPaliICR=10×, ECR=8.3×2026.0548.3
LensVLMSFTICR=15×, ECR=10.7×2026.0548.1
Jina-v4-MMICR=15×, ECR=11.9×2026.0546.6
LLMLingua-2ICR=10×, ECR=11.3×2026.0542
ColPaliICR=15×, ECR=11.9×2026.0539.7
Base + ExpandICR=5×, ECR=4.5×2026.0538.5
LLMLingua-2ICR=15×, ECR=15.7×2026.0536.2
Comp. ImageICR=5×, ECR=5×2026.0535.6
Base + ExpandICR=10×, ECR=8.0×2026.0530.5
Base + ExpandICR=15×, ECR=11.0×2026.0525.3
Comp. ImageICR=10×, ECR=10×2026.0521.3
Comp. ImageICR=15×, ECR=15×2026.0516.1