Closed-book Question Answering on NaturalQuestions (test)
43.62EMDCO
Evaluation results
| Method | Links | |
|---|---|---|
| DCOBackbone=Llama-3-70B2026.06 | 43.62 | |
| DeCoRe (static)Backbone=Llama-3-70B2026.06 | 40.41 | |
| ADBackbone=Llama-3-70B2026.06 | 40.23 | |
| GreedyBackbone=Llama-3-70B2026.06 | 40.08 | |
| DoLa (low)Backbone=Llama-3-70B2026.06 | 40.08 | |
| DoLa (high)Backbone=Llama-3-70B2026.06 | 39.59 | |
| ITIBackbone=Llama-3-70B2026.06 | 38.57 | |
| CDBackbone=Llama-3-70B2026.06 | 36.23 | |
| DCOBackbone=Llama-3-8B2026.06 | 30.92 | |
| DeCoRe (static)Backbone=Llama-3-8B2026.06 | 29.42 | |
| DoLa (high)Backbone=Llama-3-8B2026.06 | 29.19 | |
| DoLa (low)Backbone=Llama-3-8B2026.06 | 29.15 | |
| GreedyBackbone=Llama-3-8B2026.06 | 29.04 | |
| ADBackbone=Llama-3-8B2026.06 | 28.32 | |
| BART-LargeQA-finetune=true2021.06 | 23 | |
| ITIBackbone=Llama-3-8B2026.06 | 22.07 | |
| INTRADocL=2K, Number of demonstrations=122024.02 | 7.17 | |
| BM25ChunkL=2K, Number of demonstrations=122024.02 | 7.1 | |
| INTRADocL=8K, Number of demonstrations=482024.02 | 6.89 | |
| UNIChunkL=2K, Number of demonstrations=122024.02 | 6.7 | |
| MixChunkL=2K, Number of demonstrations=122024.02 | 6.19 | |
| BM25ChunkL=8K, Number of demonstrations=482024.02 | 5.37 | |
| UNIChunkL=8K, Number of demonstrations=482024.02 | 5.25 | |
| MixChunkL=8K, Number of demonstrations=482024.02 | 5.08 |