Scientific Question Answering on GPQA Main (test)
23.04P@1DecepChain
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DecepChainModel=DeepSeek-R1-Distill-Qwen-1.5B2025.09 | 23.04 | 85.02 | 34.98 | |
| DecepChainModel=Qwen2.5-Math-1.5B2025.09 | 18.35 | 83.21 | 8.52 | |
| BaseRLModel=Llama3.2-3B-Instruct2025.09 | 17.99 | — | — | |
| BadNetModel=Qwen2.5-Math-7B2025.09 | 17.76 | 61.47 | 0 | |
| BaseRLModel=Qwen2.5-Math-1.5B2025.09 | 17.63 | — | — | |
| BaseRLModel=DeepSeek-R1-Distill-Qwen-1.5B2025.09 | 16.7 | — | — | |
| BaseRLModel=Qwen2.5-Math-7B2025.09 | 16.07 | — | — | |
| DecepChainModel=Llama3.2-3B-Instruct2025.09 | 15.67 | 87.14 | 17.93 | |
| DecepChainModel=Qwen2.5-Math-7B2025.09 | 15.25 | 88.48 | 24.41 | |
| DT-COTModel=Llama3.2-3B-Instruct2025.09 | 14.87 | 81.88 | 0 | |
| BadChainModel=Llama3.2-3B-Instruct2025.09 | 14.78 | 88.8 | 24.23 | |
| BadNetModel=Qwen2.5-Math-1.5B2025.09 | 13.48 | 86.16 | 0 | |
| BadNetModel=DeepSeek-R1-Distill-Qwen-1.5B2025.09 | 12.37 | 82.51 | 0 | |
| BadChainModel=Qwen2.5-Math-7B2025.09 | 11.34 | 87.46 | 0 | |
| DT-COTModel=Qwen2.5-Math-7B2025.09 | 11.21 | 86.86 | 0 | |
| DT-COTModel=Qwen2.5-Math-1.5B2025.09 | 8.3 | 81.43 | 0 | |
| BadChainModel=Qwen2.5-Math-1.5B2025.09 | 7.37 | 78.84 | 0 | |
| BadNetModel=Llama3.2-3B-Instruct2025.09 | 4.51 | 74.42 | 0 | |
| DT-COTModel=DeepSeek-R1-Distill-Qwen-1.5B2025.09 | 3.39 | 94.26 | 0 | |
| BadChainModel=DeepSeek-R1-Distill-Qwen-1.5B2025.09 | 3.26 | 93.53 | 0 |