Commonsense Reasoning on CommonsenseQA Non-Math
87.31AccuracyToN
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ToNBackbone=QwQ-32B, Temperature=0.02025.12 | 87.31 | 3.2 | 543.03 | -46.8 | |
| ToNBackbone=QwQ-32B, Temperature=0.62025.12 | 87.06 | 2.41 | 607.19 | -36.1 | |
| LYNXBackbone=QwQ-32B, Conf=0.97, Temperature=0.62025.12 | 85.67 | 0.78 | 733.78 | -22.8 | |
| LYNXBackbone=QwQ-32B, Conf=0.95, Temperature=0.62025.12 | 85.18 | 0.2 | 653.96 | -31.2 | |
| BaselineBackbone=QwQ-32B, Temperature=0.62025.12 | 85.01 | — | 950.51 | — | |
| LYNXBackbone=QwQ-32B, Conf=0.9, Temperature=0.62025.12 | 85.01 | 0 | 541.47 | -43 | |
| DEERBackbone=QwQ-32B, Temperature=0.02025.12 | 84.93 | 0.39 | 622.98 | -39 | |
| LYNXBackbone=QwQ-32B, Conf=0.95, Temperature=0.02025.12 | 84.85 | 0.3 | 770.27 | -24.6 | |
| LYNXBackbone=QwQ-32B, Conf=0.80, Temperature=0.02025.12 | 84.85 | 0.3 | 548.42 | -46.3 | |
| DEERBackbone=QwQ-32B, Temperature=0.62025.12 | 84.77 | -0.28 | 643.47 | -32.3 | |
| LYNXBackbone=QwQ-32B, Conf=0.90, Temperature=0.02025.12 | 84.77 | 0.2 | 667.02 | -34.7 | |
| BaselineBackbone=QwQ-32B, Temperature=0.02025.12 | 84.6 | — | 1,021.04 | — | |
| LYNXBackbone=QwQ-32B, Conf=0.97, Temperature=0.02025.12 | 84.52 | -0.09 | 911.14 | -10.8 | |
| LYNXBackbone=QwQ-32B, Conf=0.70, Temperature=0.02025.12 | 84.44 | -0.19 | 394.24 | -61.4 | |
| LYNXBackbone=QwQ-32B, Conf=0.7, Temperature=0.62025.12 | 83.46 | -1.82 | 331.83 | -65.1 | |
| LYNXBackbone=QwQ-32B, Conf=0.8, Temperature=0.62025.12 | 83.37 | -1.93 | 402.35 | -57.7 | |
| ToNBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Temperature=0.62025.12 | 45.29 | 7.37 | 559.95 | -30.3 | |
| ToNBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Temperature=0.02025.12 | 44.31 | 9.3 | 757.52 | -67.6 | |
| LYNXBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Conf=0.8, Temperature=0.62025.12 | 43.24 | 2.51 | 599.9 | -25.3 | |
| LYNXBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Conf=0.9, Temperature=0.62025.12 | 42.92 | 1.75 | 691.1 | -13.9 | |
| DEERBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Temperature=0.62025.12 | 42.75 | 1.35 | 590.8 | -26.4 | |
| LYNXBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Conf=0.95, Temperature=0.62025.12 | 42.42 | 0.57 | 738.9 | -8 | |
| LYNXBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Conf=0.97, Temperature=0.62025.12 | 42.26 | 0.19 | 752.8 | -6.3 | |
| BaselineBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Temperature=0.62025.12 | 42.18 | — | 803.1 | — | |
| LYNXBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Conf=0.7, Temperature=0.62025.12 | 42.1 | -0.19 | 365 | -54.6 | |
| DEERBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Temperature=0.02025.12 | 41.36 | 2.02 | 1,085.95 | -53.5 | |
| LYNXBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Conf=0.80, Temperature=0.02025.12 | 41.2 | 1.63 | 1,254.09 | -46.3 | |
| LYNXBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Conf=0.90, Temperature=0.02025.12 | 40.95 | 1.01 | 1,850.4 | -20.8 | |
| LYNXBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Conf=0.97, Temperature=0.02025.12 | 40.62 | 0.2 | 2,219.8 | -5 | |
| LYNXBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Conf=0.70, Temperature=0.02025.12 | 40.62 | 0.2 | 609.7 | -73.9 | |
| BaselineBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Temperature=0.02025.12 | 40.54 | — | 2,335.69 | — | |
| LYNXBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Conf=0.95, Temperature=0.02025.12 | 40.38 | -0.39 | 2,085.18 | -10.7 |