Multiple Choice Question Answering on BGB (test)
78.8Exact AccuracyGPT-5 (min. reasoning)
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-5 (min. reasoning)Train Data=Base Model2026.01 | 78.8 | |
| GPT-5-mini (min. reasoning)Train Data=Base Model2026.01 | 75.8 | |
| Gemma 3 (12B)Train Data=Difficulty-Graded QA Data2026.01 | 75.1 | |
| LLaMA 3.1 (8B)Train Data=Difficulty-Graded QA Data2026.01 | 68.2 | |
| Gemma 3 (12B)Train Data=Standard Instruction QA Data2026.01 | 67.1 | |
| Gemma 3 (12B)Train Data=Base Model2026.01 | 67 | |
| LLaMA 3.1 (8B)Train Data=Standard Instruction QA Data2026.01 | 64.2 | |
| LLaMA 3.1 (8B)Train Data=Base Model2026.01 | 64 |