Question Answering on TriviaQA (recall)
92.3Recall (%)AGDLRPc
Evaluation Results
| Method | Links | |
|---|---|---|
| AGDLRPcModel=Qwen 2.5 (7B), Setting=Open-book2025.09 | 92.3 | |
| AGDI×GhModel=Qwen 2.5 (7B), Setting=Open-book2025.09 | 91.7 | |
| AGDLRPcModel=Llama 3.1 (8B), Setting=Open-book2025.09 | 91.4 | |
| AGDI×GhModel=Llama 3.1 (8B), Setting=Open-book2025.09 | 91.2 | |
| NucleusModel=Qwen 2.5 (7B), Setting=Open-book2025.09 | 91.2 | |
| GreedyModel=Qwen 2.5 (7B), Setting=Open-book2025.09 | 91.1 | |
| AGDI×GcModel=Qwen 2.5 (7B), Setting=Open-book2025.09 | 91.1 | |
| AGDLRPhModel=Llama 3.1 (8B), Setting=Open-book2025.09 | 91 | |
| AGDLRPhModel=Qwen 2.5 (7B), Setting=Open-book2025.09 | 91 | |
| NucleusModel=Llama 3.1 (8B), Setting=Open-book2025.09 | 89.7 | |
| AGDI×GcModel=Llama 3.1 (8B), Setting=Open-book2025.09 | 89.7 | |
| GreedyModel=Llama 3.1 (8B), Setting=Open-book2025.09 | 89.4 | |
| CADModel=Qwen 2.5 (7B), Setting=Open-book2025.09 | 88.6 | |
| CADModel=Llama 3.1 (8B), Setting=Open-book2025.09 | 87.9 | |
| AGDLRPcModel=Gemma 3 (4B), Setting=Open-book2025.09 | 83.9 | |
| AGDLRPhModel=Gemma 3 (4B), Setting=Open-book2025.09 | 83.4 | |
| GreedyModel=Gemma 3 (4B), Setting=Open-book2025.09 | 83.2 | |
| NucleusModel=Gemma 3 (4B), Setting=Open-book2025.09 | 83 | |
| AGDI×GhModel=Gemma 3 (4B), Setting=Open-book2025.09 | 83 | |
| AGDI×GcModel=Gemma 3 (4B), Setting=Open-book2025.09 | 83 | |
| AGDLRPhModel=Llama 3.1 (8B), Setting=Closed-book2025.09 | 82.4 | |
| CADModel=Gemma 3 (4B), Setting=Open-book2025.09 | 82 | |
| GreedyModel=Llama 3.1 (8B), Setting=Closed-book2025.09 | 81.4 | |
| DoLAModel=Llama 3.1 (8B), Setting=Closed-book2025.09 | 81.2 | |
| AGDI×GhModel=Llama 3.1 (8B), Setting=Closed-book2025.09 | 81.2 | |
| NucleusModel=Llama 3.1 (8B), Setting=Closed-book2025.09 | 79 | |
| AGDLRPhModel=Qwen 2.5 (7B), Setting=Closed-book2025.09 | 70.3 | |
| GreedyModel=Qwen 2.5 (7B), Setting=Closed-book2025.09 | 69.3 | |
| AGDI×GhModel=Qwen 2.5 (7B), Setting=Closed-book2025.09 | 69.1 | |
| NucleusModel=Qwen 2.5 (7B), Setting=Closed-book2025.09 | 68.8 | |
| DoLAModel=Qwen 2.5 (7B), Setting=Closed-book2025.09 | 67.9 | |
| GreedyModel=Gemma 3 (4B), Setting=Closed-book2025.09 | 61.9 | |
| AGDLRPhModel=Gemma 3 (4B), Setting=Closed-book2025.09 | 61.5 | |
| NucleusModel=Gemma 3 (4B), Setting=Closed-book2025.09 | 61.3 | |
| AGDI×GhModel=Gemma 3 (4B), Setting=Closed-book2025.09 | 61 | |
| DoLAModel=Gemma 3 (4B), Setting=Closed-book2025.09 | 60.5 |