Multiple Choice Question Answering on Teach-QA 1.0 (test)
75.6Remember AccuracyQwen-2.5-72B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Qwen-2.5-72Binference_mode=Zero-shot2026.01 | 75.6 | 68.9 | 57.7 | 90.5 | 73.2 | |
| GPT-4o-Miniinference_mode=Zero-shot2026.01 | 71.7 | 66.2 | 61.8 | 85 | 71.2 | |
| GPT-4oinference_mode=Zero-shot2026.01 | 71.2 | 60.8 | 48.2 | 87.9 | 67 | |
| DeepSeek-V3inference_mode=Zero-shot2026.01 | 69.9 | 73 | 59.5 | 90.4 | 73.2 | |
| Kimi-K2inference_mode=Zero-shot2026.01 | 69.2 | 65.9 | 62 | 89.7 | 71.7 | |
| Qwen-2-72B-Instructinference_mode=Zero-shot2026.01 | 66.9 | 63 | 57.5 | 85.2 | 68.2 | |
| Llama-3-70Binference_mode=Zero-shot2026.01 | 51.2 | 29.9 | 21.5 | 42.7 | 36.3 | |
| Mixtral-8x7Binference_mode=Zero-shot2026.01 | 20.6 | 20.6 | 19.9 | 21.3 | 20.6 |