Information Retrieval on MultiHopRAG (test)
63.58MRR@10RankGPT (gpt-4o)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| RankGPT (gpt-4o)Method Category=RERANKING2025.07 | 63.58 | 76.28 | 17.99 | 36.01 | |
| RankLlamaMethod Category=RERANKING2025.07 | 63.11 | 77.03 | 16.79 | 33.75 | |
| bge-reranker-largeMethod Category=RERANKING2025.07 | 60.19 | 74.81 | 16.19 | 32.76 | |
| SETR-CoT & IRIMethod Category=SET SELECTION (OURS), reasoning_strategy=Chain-of-Thought & Information Requirement Identification2025.07 | 57.42 | 72.55 | 22.68 | 36.69 | |
| SETR-Selection onlyMethod Category=SET SELECTION (OURS)2025.07 | 56.1 | 72.95 | 21.87 | 35.54 | |
| SETR-CoTMethod Category=SET SELECTION (OURS), reasoning_strategy=Chain-of-Thought2025.07 | 55.33 | 72.81 | 20.47 | 34.13 | |
| RankZephyrMethod Category=RERANKING2025.07 | 53.26 | 70.46 | 13.4 | 26.85 | |
| RankVicunaMethod Category=RERANKING2025.07 | 50.77 | 72.32 | 13.72 | 27.6 | |
| bge-large-en-v1.5Method Category=RETRIEVAL ONLY2025.07 | 45.23 | 69 | 16.12 | 32.32 | |
| FirstMistralMethod Category=RERANKING2025.07 | 45.21 | 68.95 | 13.21 | 26.71 | |
| BM25Method Category=RETRIEVAL ONLY2025.07 | 44.29 | 68.27 | 11.09 | 24.13 |