Reasoning on Reasoning Domain Logic
79.8ScoreREP
Evaluation results
| Method | Links | |
|---|---|---|
| REPBackbone=Qwen-2.5-7B-Instruct2026.02 | 79.8 | |
| STEER2ADAPTBackbone=Qwen-2.5-7B-Instruct2026.02 | 79.68 | |
| Direct InferenceBackbone=Qwen-2.5-7B-Instruct2026.02 | 79.45 | |
| CAABackbone=Qwen-2.5-7B-Instruct2026.02 | 77.07 | |
| Few-ShotBackbone=Qwen-2.5-7B-Instruct, n=12026.02 | 75.44 | |
| ICLBackbone=Qwen-2.5-7B-Instruct2026.02 | 74.56 | |
| Few-ShotBackbone=Qwen-2.5-7B-Instruct, n=22026.02 | 74.49 | |
| STEER2ADAPTBackbone=Llama-3.1-8B-Instruct2026.02 | 69.27 | |
| STEER2ADAPTBackbone=Mistral-7B-Instruct-v0.12026.02 | 67.89 | |
| Direct InferenceBackbone=Mistral-7B-Instruct-v0.12026.02 | 66.9 | |
| Direct InferenceBackbone=Llama-3.1-8B-Instruct2026.02 | 64.57 | |
| Few-ShotBackbone=Llama-3.1-8B-Instruct, n=12026.02 | 64.37 | |
| CAABackbone=Llama-3.1-8B-Instruct2026.02 | 63.7 | |
| Few-ShotBackbone=Llama-3.1-8B-Instruct, n=22026.02 | 62.89 | |
| CAABackbone=Mistral-7B-Instruct-v0.12026.02 | 62.35 | |
| REPBackbone=Mistral-7B-Instruct-v0.12026.02 | 61.26 | |
| REPBackbone=Llama-3.1-8B-Instruct2026.02 | 60.97 | |
| ICLBackbone=Mistral-7B-Instruct-v0.12026.02 | 60.5 | |
| ICLBackbone=Llama-3.1-8B-Instruct2026.02 | 59.48 | |
| Few-ShotBackbone=Mistral-7B-Instruct-v0.1, n=12026.02 | 52.81 | |
| Few-ShotBackbone=Mistral-7B-Instruct-v0.1, n=22026.02 | 49.69 |