Science Question Answering on GPQA (Accuracy, Memory, and Time)
0.21Memory RatioAC
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ACBackbone model=Qwen3-4B2026.01 | 0.21 | 2.11 | 65.03 | |
| T2Backbone model=Llama3.1-8B2026.01 | 0.25 | 0.37 | 36.5 | |
| T2Backbone model=Deepseek-R1-Distill-Qwen-7B2026.01 | 0.25 | 0.45 | 55.53 | |
| DSCBackbone model=Llama3.1-8B2026.01 | 0.26 | 2.08 | 35.92 | |
| T2Backbone model=Qwen2.5-7B2026.01 | 0.27 | 0.51 | 39.17 | |
| T2Backbone model=Qwen3-4B2026.01 | 0.27 | 0.46 | 65.17 | |
| DSCBackbone model=Qwen2.5-7B2026.01 | 0.31 | 2.18 | 38.12 | |
| ESCBackbone model=Llama3.1-8B2026.01 | 0.32 | 2.38 | 36.45 | |
| ESCBackbone model=Qwen3-4B2026.01 | 0.32 | 1.97 | 65.12 | |
| ESCBackbone model=Qwen2.5-7B2026.01 | 0.36 | 2.27 | 39.05 | |
| DSCBackbone model=Qwen3-4B2026.01 | 0.36 | 3.92 | 64.21 | |
| ACBackbone model=Llama3.1-8B2026.01 | 0.37 | 2.99 | 36.24 | |
| ACBackbone model=Qwen2.5-7B2026.01 | 0.38 | 2.7 | 38.79 | |
| ESCBackbone model=Deepseek-R1-Distill-Qwen-7B2026.01 | 0.43 | 1.67 | 55.42 | |
| DeepConfBackbone model=Qwen3-4B2026.01 | 0.49 | 3.2 | 64.87 | |
| DeepConfBackbone model=Llama3.1-8B2026.01 | 0.52 | 4.17 | 34.49 | |
| DeepConfBackbone model=Qwen2.5-7B2026.01 | 0.53 | 3.41 | 39.19 | |
| ACBackbone model=Deepseek-R1-Distill-Qwen-7B2026.01 | 0.54 | 2.62 | 54.67 | |
| DSCBackbone model=Deepseek-R1-Distill-Qwen-7B2026.01 | 0.6 | 4.03 | 52.99 | |
| DeepConfBackbone model=Deepseek-R1-Distill-Qwen-7B2026.01 | 0.65 | 3.8 | 53.13 | |
| Std-PT.Backbone model=Qwen2.5-7B2026.01 | 1 | 1 | 39.49 | |
| Std-PT.Backbone model=Llama3.1-8B2026.01 | 1 | 1 | 36.66 | |
| Std-PT.Backbone model=Deepseek-R1-Distill-Qwen-7B2026.01 | 1 | 1 | 55.29 | |
| Std-PT.Backbone model=Qwen3-4B2026.01 | 1 | 1 | 65.33 |