Multi-hop reasoning on MuSiQue Closed Book (test)
21.14Accuracy/F1DCO (Ours)
Evaluation Results
| Method | Links | |
|---|---|---|
| DCO (Ours)Model=Llama-3-70B, Chain-of-Thought=With CoT2026.06 | 21.14 | |
| DeCoRe (static)Model=Llama-3-70B, Chain-of-Thought=With CoT2026.06 | 20.6 | |
| ITIModel=Llama-3-70B, Chain-of-Thought=With CoT2026.06 | 20.44 | |
| ADModel=Llama-3-70B, Chain-of-Thought=With CoT2026.06 | 20.23 | |
| GreedyModel=Llama-3-70B, Chain-of-Thought=With CoT2026.06 | 20.15 | |
| DoLaModel=Llama-3-70B, Chain-of-Thought=With CoT2026.06 | 20.15 | |
| CDModel=Llama-3-70B, Chain-of-Thought=With CoT2026.06 | 17.17 | |
| DoLaModel=Llama-3-8B, Chain-of-Thought=With CoT2026.06 | 14.94 | |
| DeCoRe (static)Model=Llama-3-8B, Chain-of-Thought=With CoT2026.06 | 14.69 | |
| GreedyModel=Llama-3-8B, Chain-of-Thought=With CoT2026.06 | 14.61 | |
| DCO (Ours)Model=Llama-3-8B, Chain-of-Thought=With CoT2026.06 | 14.56 | |
| ADModel=Llama-3-8B, Chain-of-Thought=With CoT2026.06 | 14.4 | |
| DCO (Ours)Model=Llama-3-70B, Chain-of-Thought=Without CoT2026.06 | 11.96 | |
| GreedyModel=Llama-3-70B, Chain-of-Thought=Without CoT2026.06 | 11.79 | |
| DeCoRe (static)Model=Llama-3-70B, Chain-of-Thought=Without CoT2026.06 | 11.79 | |
| DoLaModel=Llama-3-70B, Chain-of-Thought=Without CoT2026.06 | 11.42 | |
| ADModel=Llama-3-70B, Chain-of-Thought=Without CoT2026.06 | 11.38 | |
| CDModel=Llama-3-70B, Chain-of-Thought=Without CoT2026.06 | 10.92 | |
| ITIModel=Llama-3-70B, Chain-of-Thought=Without CoT2026.06 | 10.88 | |
| DeCoRe (static)Model=Llama-3-8B, Chain-of-Thought=Without CoT2026.06 | 7.9 | |
| GreedyModel=Llama-3-8B, Chain-of-Thought=Without CoT2026.06 | 7.41 | |
| DCO (Ours)Model=Llama-3-8B, Chain-of-Thought=Without CoT2026.06 | 7.41 | |
| DoLaModel=Llama-3-8B, Chain-of-Thought=Without CoT2026.06 | 7.24 | |
| ADModel=Llama-3-8B, Chain-of-Thought=Without CoT2026.06 | 6.99 | |
| ITIModel=Llama-3-8B, Chain-of-Thought=With CoT2026.06 | 4.18 | |
| ITIModel=Llama-3-8B, Chain-of-Thought=Without CoT2026.06 | 4.01 |