Mathematical Reasoning on Math-MC (test)
58.04AccuracyCORAL
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CORALBackbone=Qwen2.5-7B-Instruct, Transfer Experiments=Probe 12026.02 | 58.04 | 3.22 | 3.06 | 63.31 | 21.89 | |
| FewshotBackbone=Qwen2.5-7B-Instruct, Transfer Experiments=Probe 12026.02 | 56.78 | 5.12 | 3.19 | 64.49 | 22.09 | |
| CCPSBackbone=Qwen2.5-7B-Instruct, Transfer Experiments=Probe 12026.02 | 55.74 | 22.58 | 3.71 | 80.57 | 29.32 | |
| CORALBackbone=Mistral-7B-Instruct-v0.3, Transfer Experiments=Probe 12026.02 | 45.65 | 3.2 | 2.78 | 65.42 | 23.12 | |
| FewshotBackbone=Mistral-7B-Instruct-v0.3, Transfer Experiments=Probe 12026.02 | 44.89 | 20.16 | 8.67 | 91.55 | 29.38 | |
| CCPSBackbone=Mistral-7B-Instruct-v0.3, Transfer Experiments=Probe 12026.02 | 44.4 | 34.57 | 2.45 | 105.13 | 37.51 | |
| CORALBackbone=Deepseek-7B-Chat, Transfer Experiments=Probe 12026.02 | 43.73 | 6.46 | 3.37 | 66.21 | 23.47 | |
| FewshotBackbone=Deepseek-7B-Chat, Transfer Experiments=Probe 12026.02 | 39.95 | 13.11 | 6.02 | 73.64 | 25.71 | |
| CCPSBackbone=Deepseek-7B-Chat, Transfer Experiments=Probe 12026.02 | 39.93 | 40.93 | 3.58 | 111.61 | 41.08 | |
| SteerConfBackbone=Qwen2.5-7B-Instruct, Transfer Experiments=Probe 12026.02 | 38.28 | 11.15 | 4.31 | 71.62 | 27.89 | |
| ITIBackbone=Qwen2.5-7B-Instruct, Transfer Experiments=Probe 12026.02 | 34.85 | 19.29 | 13.55 | 110.44 | 38.76 | |
| SteerConfBackbone=Mistral-7B-Instruct-v0.3, Transfer Experiments=Probe 12026.02 | 30.27 | 43.9 | 11.72 | 101.67 | 37.09 | |
| ITIBackbone=Mistral-7B-Instruct-v0.3, Transfer Experiments=Probe 12026.02 | 27.55 | 75.94 | 36.83 | 156.77 | 51.56 | |
| SteerConfBackbone=Deepseek-7B-Chat, Transfer Experiments=Probe 12026.02 | 26.94 | 28.55 | 8.14 | 81.78 | 32.46 | |
| ITIBackbone=Deepseek-7B-Chat, Transfer Experiments=Probe 12026.02 | 24.52 | 49.39 | 25.57 | 126.1 | 45.12 |