Reasoning on Reasoning Domain Code
76.25Reasoning ScoreSTEER2ADAPT
Evaluation results
| Method | Links | |
|---|---|---|
| STEER2ADAPTBackbone=Qwen-2.5-7B-Instruct2026.02 | 76.25 | |
| Few-ShotBackbone=Qwen-2.5-7B-Instruct, n=22026.02 | 72.54 | |
| REPBackbone=Qwen-2.5-7B-Instruct2026.02 | 72.41 | |
| STEER2ADAPTBackbone=Llama-3.1-8B-Instruct2026.02 | 72.25 | |
| CAABackbone=Qwen-2.5-7B-Instruct2026.02 | 71.97 | |
| Few-ShotBackbone=Qwen-2.5-7B-Instruct, n=12026.02 | 71.69 | |
| Direct InferenceBackbone=Qwen-2.5-7B-Instruct2026.02 | 71.15 | |
| ICLBackbone=Qwen-2.5-7B-Instruct2026.02 | 71.12 | |
| REPBackbone=Llama-3.1-8B-Instruct2026.02 | 67 | |
| CAABackbone=Llama-3.1-8B-Instruct2026.02 | 60.81 | |
| Direct InferenceBackbone=Llama-3.1-8B-Instruct2026.02 | 59.11 | |
| ICLBackbone=Llama-3.1-8B-Instruct2026.02 | 57.93 | |
| Few-ShotBackbone=Llama-3.1-8B-Instruct, n=12026.02 | 55.47 | |
| Few-ShotBackbone=Llama-3.1-8B-Instruct, n=22026.02 | 55.23 | |
| STEER2ADAPTBackbone=Mistral-7B-Instruct-v0.12026.02 | 52.65 | |
| REPBackbone=Mistral-7B-Instruct-v0.12026.02 | 51.4 | |
| Few-ShotBackbone=Mistral-7B-Instruct-v0.1, n=12026.02 | 49.69 | |
| Few-ShotBackbone=Mistral-7B-Instruct-v0.1, n=22026.02 | 49.69 | |
| ICLBackbone=Mistral-7B-Instruct-v0.12026.02 | 49.65 | |
| Direct InferenceBackbone=Mistral-7B-Instruct-v0.12026.02 | 49.49 | |
| CAABackbone=Mistral-7B-Instruct-v0.12026.02 | 49.3 |