Open-Book Question Answering on NQ-Open Open-Book (Exact Match)
79.51Exact MatchDCO
Evaluation results
| Method | Links | |
|---|---|---|
| DCOModel=Llama-3-70B2026.06 | 79.51 | |
| DCOModel=Llama-3-8B2026.06 | 74.95 | |
| DeCoRe (static)Model=Llama-3-70B2026.06 | 72.51 | |
| ITIModel=Llama-3-70B2026.06 | 71.9 | |
| CADModel=Llama-3-70B2026.06 | 71.83 | |
| ADModel=Llama-3-70B2026.06 | 71.15 | |
| GreedyModel=Llama-3-70B2026.06 | 71.07 | |
| DoLa (low)Model=Llama-3-70B2026.06 | 71.07 | |
| DeCoRe (static)Model=Llama-3-8B2026.06 | 70.62 | |
| DoLa (high)Model=Llama-3-70B2026.06 | 70.4 | |
| CADModel=Llama-3-8B2026.06 | 69.83 | |
| GreedyModel=Llama-3-8B2026.06 | 69.68 | |
| DoLa (low)Model=Llama-3-8B2026.06 | 69.68 | |
| DoLa (high)Model=Llama-3-8B2026.06 | 69.49 | |
| ADModel=Llama-3-8B2026.06 | 68.93 | |
| CDModel=Llama-3-70B2026.06 | 65.8 | |
| ITIModel=Llama-3-8B2026.06 | 56.16 |