Question Answering on IIRC
20.1EMDioR
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DioRRetrieval Strategy=BM25, Backbone=LLaMA2-7B-CHAT2025.04 | 20.1 | 24.5 | 25.5 | 24.3 | |
| DioRBackbone=LLaMA2-7B-CHAT2025.04 | 20.1 | 24.5 | — | — | |
| RADIOBackbone=LLaMA2-7B-CHAT2025.04 | 19.6 | 23.9 | — | — | |
| SEAKRBackbone=LLaMA2-7B-CHAT2025.04 | 19.5 | 23.5 | — | — | |
| SR-RAGBackbone=LLaMA2-7B-CHAT2025.04 | 18.7 | 22.6 | — | — | |
| DioRRetrieval Strategy=SGPT, Backbone=LLaMA2-7B-CHAT2025.04 | 17.8 | 22.4 | 22.9 | 21.9 | |
| FS-RAGBackbone=LLaMA2-7B-CHAT2025.04 | 17.8 | 21.6 | — | — | |
| FL-RAGBackbone=LLaMA2-7B-CHAT2025.04 | 17.2 | 20.3 | — | — | |
| DraginRetrieval Strategy=BM25, Backbone=LLaMA2-7B-CHAT2025.04 | 15.6 | 18.8 | 19.5 | 19.6 | |
| DraginBackbone=LLaMA2-7B-CHAT2025.04 | 15.6 | 18.8 | — | — | |
| DioRRetrieval Strategy=SBERT, Backbone=LLaMA2-7B-CHAT2025.04 | 15.3 | 17.9 | 18.5 | 18.9 | |
| DraginRetrieval Strategy=SBERT, Backbone=LLaMA2-7B-CHAT2025.04 | 14.2 | 17.2 | 17.6 | 18 | |
| wo-RAGBackbone=LLaMA2-7B-CHAT2025.04 | 13.9 | 17.3 | — | — | |
| FLAREBackbone=LLaMA2-7B-CHAT2025.04 | 13.6 | 16.4 | — | — | |
| DraginRetrieval Strategy=SGPT, Backbone=LLaMA2-7B-CHAT2025.04 | 12.5 | 15.3 | 15.9 | 15.6 |