Group-level distractor generation on MMLU Elementary Math
34.95RecallDeepseek-V3
Evaluation Results
| Method | Links | |
|---|---|---|
| Deepseek-V3Framework=MCTS-guided reasoning reconstruction, Backbone=Deepseek-V32025.08 | 34.95 | |
| Claude-4-SonnetFramework=MCTS-guided reasoning reconstruction, Backbone=Claude-4-Sonnet2025.08 | 32.44 | |
| LLaMA-3-70BFramework=MCTS-guided reasoning reconstruction, Backbone=LLaMA-3-70B2025.08 | 30.29 | |
| GPT-4oFramework=MCTS-guided reasoning reconstruction, Backbone=GPT-4o2025.08 | 30.29 | |
| GPT-3.5-turboFramework=MCTS-guided reasoning reconstruction, Backbone=GPT-3.5-turbo2025.08 | 27.96 | |
| DiVERT2025.08 | 25.09 | |
| O&A2025.08 | 22.22 | |
| D-GEN2025.08 | 18.28 |