Fact Retrieval on WCEP
23.8F1 ScoreThought-Retriever
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Thought-Retrieverretriever=Contriever, max_context_length=2,000 tokens2026.04 | 23.8 | 50 | |
| Qwen3-Embed-8btype=retriever-based, max_context_length=2,000 tokens2026.04 | 23.5 | 44 | |
| IRCoTtype=retriever-based, max_context_length=2,000 tokens2026.04 | 23.3 | 42 | |
| DRAGONtype=retriever-based, max_context_length=2,000 tokens2026.04 | 23.1 | 35 | |
| TF-IDFtype=retriever-based, max_context_length=2,000 tokens2026.04 | 22.3 | 34 | |
| Nous Hermescontext_window=32k2026.04 | 21.4 | 37 | |
| Contrievertype=retriever-based, max_context_length=2,000 tokens2026.04 | 21.1 | 40 | |
| Full Contextvariant=right2026.04 | 21 | 41 | |
| Full Contextvariant=left2026.04 | 20.7 | 35 | |
| RECOMPtype=retriever-based, max_context_length=2,000 tokens2026.04 | 20.5 | 33 | |
| DPRtype=retriever-based, max_context_length=2,000 tokens2026.04 | 20.1 | 33 | |
| BM25type=retriever-based, max_context_length=2,000 tokens2026.04 | 17.8 | 31 | |
| OpenOrcacontext_window=8k2026.04 | 16.9 | 30 |