List your company
ResearchFormerly WizWand

Text Question Answering on HELMET

78.4AccuracyLensVLM
20.26435.35750.4565.543May 7, 2026
Updated 5mo ago

Evaluation results

MethodLinks
LensVLMICR=5×, ECR=4.3×2026.0578.4
TextICR=1×, ECR=1.0×2026.0576.2
BGE-M3ICR=5×, ECR=4.5×2026.0573.8
Jina-v4ICR=5×, ECR=4.5×2026.0573.7
Jina-v4-MMICR=5×, ECR=4.6×2026.0573
Qwen3-EmbICR=5×, ECR=4.5×2026.0572.7
LensVLMSFTICR=5×, ECR=4.6×2026.0572.7
ColPaliICR=5×, ECR=4.7×2026.0571.5
LensVLMICR=10×, ECR=7.4×2026.0571.5
BM25ICR=5×, ECR=4.5×2026.0570.3
Qwen3-EmbICR=10×, ECR=8.3×2026.0570
Jina-v4ICR=10×, ECR=8.3×2026.0569.7
Jina-v4-MMICR=15×, ECR=11.9×2026.0569
Jina-v4ICR=15×, ECR=11.9×2026.0568.8
BGE-M3ICR=10×, ECR=8.3×2026.0568.3
BGE-M3ICR=15×, ECR=11.9×2026.0567.8
Qwen3-EmbICR=15×, ECR=11.9×2026.0567.5
BM25ICR=10×, ECR=8.3×2026.0565.5
GlyphICR=5×, ECR=4.5×2026.0563.5
BM25ICR=15×, ECR=11.9×2026.0563.5
LensVLMSFTICR=10×, ECR=8.1×2026.0563.2
Jina-v4-MMICR=10×, ECR=8.3×2026.0563
ColPaliICR=10×, ECR=8.3×2026.0560
LLMLingua-2ICR=5×, ECR=5.5×2026.0558.7
LensVLMICR=15×, ECR=10.1×2026.0557.2
ColPaliICR=15×, ECR=11.9×2026.0557
LensVLMSFTICR=15×, ECR=10.7×2026.0551.7
LLMLingua-2ICR=10×, ECR=11.3×2026.0550.8
GlyphICR=10×, ECR=8.6×2026.0550.5
LLMLingua-2ICR=15×, ECR=15.7×2026.0547.2
GlyphICR=15×, ECR=10.8×2026.0546
Base + ExpandICR=5×, ECR=4.5×2026.0535
Comp. ImageICR=5×, ECR=5×2026.0533.1
Base + ExpandICR=10×, ECR=8.0×2026.0530.5
Comp. ImageICR=15×, ECR=15×2026.0524.5
Base + ExpandICR=15×, ECR=11.0×2026.0524.5
Comp. ImageICR=10×, ECR=10×2026.0522.5