Fact Retrieval on AcademicEval Abstract-multi
27.5F1 ScoreThought-Retriever
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Thought-Retrieverretriever=Contriever, max_context_length=2,000 tokens2026.04 | 27.5 | 50 | |
| Qwen3-Embed-8btype=retriever-based, max_context_length=2,000 tokens2026.04 | 24 | 20 | |
| IRCoTtype=retriever-based, max_context_length=2,000 tokens2026.04 | 23.5 | 18 | |
| BM25type=retriever-based, max_context_length=2,000 tokens2026.04 | 23.2 | 7 | |
| Contrievertype=retriever-based, max_context_length=2,000 tokens2026.04 | 23.2 | 15 | |
| DPRtype=retriever-based, max_context_length=2,000 tokens2026.04 | 22.6 | 4 | |
| DRAGONtype=retriever-based, max_context_length=2,000 tokens2026.04 | 22.6 | 8 | |
| TF-IDFtype=retriever-based, max_context_length=2,000 tokens2026.04 | 22.5 | 4 | |
| Nous Hermescontext_window=32k2026.04 | 20.4 | 7 | |
| RECOMPtype=retriever-based, max_context_length=2,000 tokens2026.04 | 20.2 | 8 | |
| Full Contextvariant=left2026.04 | 15.5 | 0 | |
| Full Contextvariant=right2026.04 | 14.9 | 0 | |
| OpenOrcacontext_window=8k2026.04 | 13.5 | 3 |