Fact Retrieval on AcademicEval Related-multi
21.6F1 ScoreThought-Retriever
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Thought-Retrieverretriever=Contriever, max_context_length=2,000 tokens2026.04 | 21.6 | 50 | |
| Qwen3-Embed-8btype=retriever-based, max_context_length=2,000 tokens2026.04 | 21.1 | 35 | |
| IRCoTtype=retriever-based, max_context_length=2,000 tokens2026.04 | 20.9 | 33 | |
| DRAGONtype=retriever-based, max_context_length=2,000 tokens2026.04 | 20.8 | 30 | |
| TF-IDFtype=retriever-based, max_context_length=2,000 tokens2026.04 | 20.7 | 40 | |
| BM25type=retriever-based, max_context_length=2,000 tokens2026.04 | 20.3 | 40 | |
| Contrievertype=retriever-based, max_context_length=2,000 tokens2026.04 | 20.1 | 35 | |
| RECOMPtype=retriever-based, max_context_length=2,000 tokens2026.04 | 19.8 | 10 | |
| DPRtype=retriever-based, max_context_length=2,000 tokens2026.04 | 19.6 | 30 | |
| Full Contextvariant=left2026.04 | 19.3 | 13 | |
| Full Contextvariant=right2026.04 | 18.8 | 8 | |
| Nous Hermescontext_window=32k2026.04 | 18.3 | 15 | |
| OpenOrcacontext_window=8k2026.04 | 13.5 | 13 |