Question Answering on SQA
79.62AccuracyExGRPO
Evaluation Results
| Method | Links | |
|---|---|---|
| ExGRPOModel=Qwen2.5-7B-Instruct, Model Role=Student Model, Adapter=On-Policy Adapt.2026.02 | 79.62 | |
| ExGRPOModel=Qwen2.5-7B-Instruct, Model Role=Student Model2026.02 | 79.04 | |
| Zero-shotModel=Gemini-1.5-Pro, Model Role=Teacher Model2026.02 | 78.6 | |
| Zero-shot-EIModel=Gemini-1.5-Pro, Model Role=Teacher Model2026.02 | 78.55 | |
| On-Policy DistillationModel=Qwen2.5-7B-Instruct, Model Role=Student Model2026.02 | 78.12 | |
| Divide-or-ConquerModel=Qwen2.5-7B-Instruct, Model Role=Student Model2026.02 | 77.15 | |
| RevThinkModel=Qwen2.5-7B-Instruct, Model Role=Student Model2026.02 | 77.02 | |
| Answer AugModel=Qwen2.5-7B-Instruct, Model Role=Student Model2026.02 | 76.2 | |
| Question AugModel=Qwen2.5-7B-Instruct, Model Role=Student Model2026.02 | 75.7 | |
| Rephrase QuestionModel=Qwen2.5-7B-Instruct, Model Role=Student Model2026.02 | 75.26 | |
| Distill Step-by-StepModel=Qwen2.5-7B-Instruct, Model Role=Student Model2026.02 | 74.12 | |
| SKDModel=Qwen2.5-7B-Instruct, Model Role=Student Model2026.02 | 73.51 | |
| Zero-shotModel=Qwen2.5-7B-Instruct, Model Role=Student Model2026.02 | 72.93 | |
| ExGRPOModel=Gemma-7B-it, Model Role=Student Model, Adapter=On-Policy Adapt.2026.02 | 70.65 | |
| ExGRPOModel=Gemma-7B-it, Model Role=Student Model2026.02 | 69.43 | |
| On-Policy DistillationModel=Gemma-7B-it, Model Role=Student Model2026.02 | 66.23 | |
| RevThinkModel=Gemma-7B-it, Model Role=Student Model2026.02 | 64.19 | |
| Divide-or-ConquerModel=Gemma-7B-it, Model Role=Student Model2026.02 | 60.12 | |
| Answer AugModel=Gemma-7B-it, Model Role=Student Model2026.02 | 57.21 | |
| SKDModel=Gemma-7B-it, Model Role=Student Model2026.02 | 56.77 | |
| Distill Step-by-StepModel=Gemma-7B-it, Model Role=Student Model2026.02 | 56.77 | |
| Zero-shotModel=Gemma-7B-it, Model Role=Student Model2026.02 | 56.33 | |
| Question AugModel=Gemma-7B-it, Model Role=Student Model2026.02 | 55.1 | |
| Rephrase QuestionModel=Gemma-7B-it, Model Role=Student Model2026.02 | 54.15 |