General Text Question Answering on HotpotQA
86.7AccuracyText
Evaluation results
| Method | Links | |
|---|---|---|
| TextICR=1×, ECR=1.0×2026.05 | 86.7 | |
| LensVLMICR=5×, ECR=4.3×2026.05 | 81.5 | |
| Jina-v4ICR=5×, ECR=4.5×2026.05 | 80.7 | |
| LensVLMSFTICR=5×, ECR=4.6×2026.05 | 80.3 | |
| BM25ICR=5×, ECR=4.5×2026.05 | 80 | |
| BGE-M3ICR=5×, ECR=4.5×2026.05 | 80 | |
| VimRAGBackbone=Qwen3-VL-8B-Instruct2026.02 | 79.1 | |
| Jina-v4-MMICR=5×, ECR=4.6×2026.05 | 79 | |
| Qwen3-EmbICR=5×, ECR=4.5×2026.05 | 77.8 | |
| LensVLMICR=10×, ECR=7.4×2026.05 | 75.5 | |
| VimRAGBackbone=Qwen3-VL-4B-Instruct2026.02 | 75.1 | |
| Jina-v4-MMICR=10×, ECR=8.3×2026.05 | 73.5 | |
| Mem1Backbone=Qwen3-VL-8B-Instruct2026.02 | 73 | |
| Jina-v4ICR=10×, ECR=8.3×2026.05 | 73 | |
| LensVLMSFTICR=10×, ECR=8.1×2026.05 | 72.2 | |
| BM25ICR=10×, ECR=8.3×2026.05 | 71.5 | |
| MemAgentBackbone=Qwen3-VL-8B-Instruct2026.02 | 71.1 | |
| Mem1Backbone=Qwen3-VL-4B-Instruct2026.02 | 70.8 | |
| ReActBackbone=Qwen3-VL-8B-Instruct2026.02 | 70.8 | |
| ColPaliICR=5×, ECR=4.7×2026.05 | 70 | |
| Qwen3-EmbICR=10×, ECR=8.3×2026.05 | 68.3 | |
| BGE-M3ICR=10×, ECR=8.3×2026.05 | 67.8 | |
| MemAgentBackbone=Qwen3-VL-4B-Instruct2026.02 | 67.3 | |
| BM25ICR=15×, ECR=11.9×2026.05 | 65 | |
| LensVLMICR=15×, ECR=10.1×2026.05 | 64.5 | |
| Vanilla RAGBackbone=Qwen3-VL-8B-Instruct2026.02 | 64 | |
| Vanilla RAGBackbone=Qwen3-VL-4B-Instruct2026.02 | 63.6 | |
| Jina-v4ICR=15×, ECR=11.9×2026.05 | 63.2 | |
| ReActBackbone=Qwen3-VL-4B-Instruct2026.02 | 62.9 | |
| Qwen3-EmbICR=15×, ECR=11.9×2026.05 | 62.3 | |
| VideoRAGBackbone=Qwen3-VL-8B-Instruct2026.02 | 62 | |
| BGE-M3ICR=15×, ECR=11.9×2026.05 | 62 | |
| LensVLMSFTICR=15×, ECR=10.7×2026.05 | 60.6 | |
| VideoRAGBackbone=Qwen3-VL-4B-Instruct2026.02 | 57.2 | |
| Jina-v4-MMICR=15×, ECR=11.9×2026.05 | 56.5 | |
| ColPaliICR=10×, ECR=8.3×2026.05 | 56 | |
| UniversalRAGBackbone=Qwen3-VL-8B-Instruct2026.02 | 55.9 | |
| UniversalRAGBackbone=Qwen3-VL-4B-Instruct2026.02 | 50.9 | |
| ColPaliICR=15×, ECR=11.9×2026.05 | 50 | |
| LLMLingua-2ICR=5×, ECR=5.5×2026.05 | 47.5 | |
| Base + ExpandICR=5×, ECR=4.5×2026.05 | 45.5 | |
| GlyphICR=5×, ECR=4.5×2026.05 | 42 | |
| Base + ExpandICR=10×, ECR=8.0×2026.05 | 40 | |
| LLMLingua-2ICR=10×, ECR=11.3×2026.05 | 39.2 | |
| GlyphICR=10×, ECR=8.6×2026.05 | 37.5 | |
| LLMLingua-2ICR=15×, ECR=15.7×2026.05 | 36.8 | |
| Comp. ImageICR=5×, ECR=5×2026.05 | 33.5 | |
| Base + ExpandICR=15×, ECR=11.0×2026.05 | 32 | |
| GlyphICR=15×, ECR=10.8×2026.05 | 31.5 | |
| Comp. ImageICR=10×, ECR=10×2026.05 | 29 | |
| Comp. ImageICR=15×, ECR=15×2026.05 | 25 |