Multi-step Retrieval on MuSiQue (val)
64.5R@2KeyExtract + CoopRAG (GPT-4o-mini)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| KeyExtract + CoopRAG (GPT-4o-mini)Framework=KeyExtract, Retriever=CoopRAG, Model=GPT-4o-mini2025.12 | 64.5 | 78.6 | |
| KeyExtract + CoopRAG (Gemma2-9B)Framework=KeyExtract, Retriever=CoopRAG, Model=Gemma2-9B2025.12 | 62.9 | 76.8 | |
| IRCoT + CoopRAG (GPT-4o-mini)Framework=IRCoT, Retriever=CoopRAG, Model=GPT-4o-mini2025.12 | 62.2 | 74.9 | |
| IRCoT + HippoRAG (ColBERTv2)Framework=IRCoT, Retriever=HippoRAG, Backbone=ColBERTv22025.12 | 45.3 | 57.6 | |
| IRCoT + HippoRAG (Contriever)Framework=IRCoT, Retriever=HippoRAG, Backbone=Contriever2025.12 | 43.9 | 56.6 | |
| IRCoT + ColBERTv2Framework=IRCoT, Retriever=ColBERTv22025.12 | 41.7 | 53.7 | |
| IRCoT + ContrieverFramework=IRCoT, Retriever=Contriever2025.12 | 39.1 | 52.2 | |
| IRCoT + BM25 (Default)Framework=IRCoT, Retriever=BM252025.12 | 34.2 | 44.7 |