Multiple-choice Question Answering on Open Quiz Commons Machine Learning 2024
98.18AccuracyReasoning-trace comparison
Evaluation results
| Method | Links | |
|---|---|---|
| Reasoning-trace comparisonStrategy=Reasoning-combined, Judge Model=Phi-32026.06 | 98.18 | |
| Reasoning-trace comparisonStrategy=Reasoning-combined, Judge Model=Llama 3.22026.06 | 98.18 | |
| Reasoning-trace comparisonStrategy=Reasoning-combined, Judge Model=Gemma-22026.06 | 97.27 | |
| Gemma-2Strategy=Original Prediction2026.06 | 95.45 | |
| Phi-3Strategy=Original Prediction2026.06 | 94.55 |