Retrieval-Augmented Generation on LOFT and ICR2 Combined
74Overall ScoreGPT-4-turbo
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4-turboRAG Setting=Oracle RAG2025.01 | 74 | |
| Phi-3-7B-128KRAG Setting=Oracle RAG2025.01 | 73 | |
| Qwen-2-7B-32KRAG Setting=Oracle RAG2025.01 | 71 | |
| Mistral-2-7B-32KRAG Setting=Oracle RAG2025.01 | 70 | |
| LLaMA-3-instruct-8BRAG Setting=Oracle RAG2025.01 | 68 | |
| GPT-4-turboRAG Setting=Vanilla RAG2025.01 | 65 | |
| Qwen-2-1.5B-32KRAG Setting=Oracle RAG2025.01 | 63 | |
| Phi-3-7B-128KRAG Setting=Vanilla RAG2025.01 | 57 | |
| Qwen-2-7B-32KRAG Setting=Vanilla RAG2025.01 | 53 | |
| GPT-4-turboRAG Setting=Closed-book2025.01 | 51 | |
| Mistral-2-7B-32KRAG Setting=Vanilla RAG2025.01 | 50 | |
| LLaMA-3-instruct-8BRAG Setting=Vanilla RAG2025.01 | 45 | |
| Qwen-2-1.5B-32KRAG Setting=Vanilla RAG2025.01 | 39 | |
| Mistral-2-7B-32KRAG Setting=Closed-book2025.01 | 38 | |
| Phi-3-7B-128KRAG Setting=Closed-book2025.01 | 35 | |
| Qwen-2-7B-32KRAG Setting=Closed-book2025.01 | 31 | |
| LLaMA-3-instruct-8BRAG Setting=Closed-book2025.01 | 27 | |
| Qwen-2-1.5B-32KRAG Setting=Closed-book2025.01 | 25 |