Retrieval on Clipper
94Recall@3QRhead+ReAttn
Evaluation results
| Method | Links | ||
|---|---|---|---|
| QRhead+ReAttnBase LLM=Llama-3.1-8B-Instruct2026.02 | 94 | 97.3 | |
| QRheadBase LLM=Llama-3.1-8B-Instruct2026.02 | 93.8 | 96.9 | |
| ICR+ReAttnBase LLM=Llama-3.1-8B-Instruct2026.02 | 89.4 | 94.9 | |
| ICRBase LLM=Llama-3.1-8B-Instruct2026.02 | 89.3 | 94.7 | |
| QRhead+ReAttnBase LLM=Llama-3.2-3B-Instruct2026.02 | 85.7 | 93.5 | |
| QRheadBase LLM=Llama-3.2-3B-Instruct2026.02 | 85.5 | 93.4 | |
| StellaBase LLM=Llama-3.2-3B-Instruct2026.02 | 83.3 | 90 | |
| StellaBase LLM=Llama-3.1-8B-Instruct2026.02 | 83.3 | 90 | |
| BM25Base LLM=Llama-3.2-3B-Instruct2026.02 | 74.6 | 83.7 | |
| BM25Base LLM=Llama-3.1-8B-Instruct2026.02 | 74.6 | 83.7 | |
| ICR+ReAttnBase LLM=Llama-3.2-3B-Instruct2026.02 | 72.9 | 83.8 | |
| ICRBase LLM=Llama-3.2-3B-Instruct2026.02 | 72.8 | 83.6 | |
| ContrieverBase LLM=Llama-3.2-3B-Instruct2026.02 | 60.2 | 78.9 | |
| ContrieverBase LLM=Llama-3.1-8B-Instruct2026.02 | 60.2 | 78.9 | |
| RankGPTBubbleBase LLM=Llama-3.1-8B-Instruct2026.02 | 36.7 | 44.3 | |
| RankGPTw/oBase LLM=Llama-3.1-8B-Instruct2026.02 | 30 | 39.4 | |
| RankGPTBubbleBase LLM=Llama-3.2-3B-Instruct2026.02 | 17 | 27.4 | |
| RankGPTw/oBase LLM=Llama-3.2-3B-Instruct2026.02 | 16.8 | 27.3 |