Logical Reasoning on CLUTRR rob_train_sup_23_all (test)
45.2AccuracyLlama-3.1-8B-it (w/ SLR)
Evaluation results
| Method | Links | |
|---|---|---|
| Llama-3.1-8B-it (w/ SLR)Model=Llama-3.1-8B-it, Variant=w/ SLR, Decoding Strategy=Greedy decoding2025.06 | 45.2 | |
| Llama-3.1-8B-it (Base)Model=Llama-3.1-8B-it, Variant=Base, Decoding Strategy=Greedy decoding2025.06 | 43.2 | |
| Llama-3.1-8B-it (w/ DeepSeek-R1)Model=Llama-3.1-8B-it, Variant=w/ DeepSeek-R1, Decoding Strategy=Greedy decoding2025.06 | 23 |