Information Retrieval on LIMIT benchmark (test)
85.7Recall@2BM25
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BM25Dim=default2025.10 | 85.7 | 90.4 | 93.6 | |
| MILCOComponents=SAP, SCTKD, LexEcho, Dim=280,5242025.10 | 26.2 | 47 | 73.5 | |
| GTE-ModernColBERTDim=default2025.10 | 23.1 | 34.6 | 54.8 | |
| GritLM 7BDim=40962025.10 | 2.4 | 4.1 | 12.9 | |
| GritLM 7BDim=20482025.10 | 2.3 | 4.3 | 11.8 | |
| GritLM 7BDim=30722025.10 | 2 | 4.3 | 12.9 | |
| GritLM 7BDim=10242025.10 | 1.8 | 3.5 | 10.6 | |
| Gemini-EmbedDim=30722025.10 | 1.6 | 3.5 | 10 | |
| GritLM 7BDim=7682025.10 | 1.5 | 3.1 | 8.7 | |
| Gemini-EmbedDim=20482025.10 | 1.5 | 3.1 | 8.5 | |
| E5-Mistral 7BDim=30722025.10 | 1.3 | 2 | 7.7 | |
| E5-Mistral 7BDim=40962025.10 | 1.3 | 2.2 | 8.3 | |
| Gemini-EmbedDim=10242025.10 | 1.3 | 2.7 | 8.1 | |
| E5-Mistral 7BDim=20482025.10 | 1 | 1.9 | 6.8 | |
| E5-Mistral 7BDim=7682025.10 | 0.9 | 1.7 | 4.3 | |
| E5-Mistral 7BDim=10242025.10 | 0.9 | 1.8 | 5.9 | |
| Qwen3-EmbedDim=20482025.10 | 0.9 | 1.7 | 4.7 | |
| Gemini-EmbedDim=7682025.10 | 0.9 | 2.5 | 7.6 | |
| Qwen3-EmbedDim=30722025.10 | 0.8 | 1.6 | 4.8 | |
| Qwen3-EmbedDim=40962025.10 | 0.8 | 1.8 | 4.8 | |
| E5-Mistral 7BDim=5122025.10 | 0.7 | 1.3 | 3.8 | |
| Qwen3-EmbedDim=7682025.10 | 0.7 | 1.5 | 3.8 | |
| Qwen3-EmbedDim=10242025.10 | 0.7 | 1.6 | 4.6 | |
| GritLM 7BDim=5122025.10 | 0.6 | 1.8 | 6.5 | |
| Qwen3-EmbedDim=5122025.10 | 0.6 | 1.3 | 3.3 | |
| E5-Mistral 7BDim=2562025.10 | 0.4 | 0.9 | 1.9 | |
| Qwen3-EmbedDim=2562025.10 | 0.4 | 0.8 | 3.2 | |
| Qwen3-EmbedDim=1282025.10 | 0.3 | 0.4 | 1.8 | |
| Gemini-EmbedDim=5122025.10 | 0.2 | 1.1 | 3.6 | |
| E5-Mistral 7BDim=1282025.10 | 0.1 | 0.3 | 1 | |
| GritLM 7BDim=1282025.10 | 0.1 | 0.3 | 1.3 | |
| GritLM 7BDim=2562025.10 | 0.1 | 0.4 | 2.8 | |
| E5-Mistral 7BDim=322025.10 | 0 | 0 | 0.5 | |
| E5-Mistral 7BDim=642025.10 | 0 | 0.1 | 0.4 | |
| GritLM 7BDim=322025.10 | 0 | 0 | 0.8 | |
| GritLM 7BDim=642025.10 | 0 | 0.1 | 0.3 | |
| Qwen3-EmbedDim=322025.10 | 0 | 0.1 | 1.1 | |
| Qwen3-EmbedDim=642025.10 | 0 | 0.2 | 1 | |
| Gemini-EmbedDim=22025.10 | 0 | 0 | 0.1 | |
| Gemini-EmbedDim=42025.10 | 0 | 0 | 0 | |
| Gemini-EmbedDim=82025.10 | 0 | 0 | 0 | |
| Gemini-EmbedDim=162025.10 | 0 | 0 | 0 | |
| Gemini-EmbedDim=322025.10 | 0 | 0 | 0 | |
| Gemini-EmbedDim=642025.10 | 0 | 0 | 0.3 | |
| Gemini-EmbedDim=1282025.10 | 0 | 0.1 | 0.3 | |
| Gemini-EmbedDim=2562025.10 | 0 | 0.1 | 1.2 |