Multiple-choice Question Answering on CiQi-Bench
77.6Dynasty AccuracyCiQi-Agent
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| CiQi-AgentParameters=7B2026.03 | 77.6 | 70.3 | 81.8 | 91.4 | 75.7 | 88.1 | 85.2 | 81.5 | |
| GPT-52026.03 | 65.7 | 61.4 | 79.6 | 86.5 | 69.3 | 83.8 | 84.3 | 75.8 | |
| GPT-4.12026.03 | 59.3 | 68.3 | 71.1 | 85 | 62.2 | 81.8 | 77.9 | 72.2 | |
| Kimi-VL-A3B-InstructParameters=16B2026.03 | 59.3 | 22.8 | 48.8 | 84.8 | 59.8 | 77.9 | 70.3 | 60.5 | |
| GPT-4o2026.03 | 59.1 | 60.4 | 68.6 | 89.2 | 70.1 | 84.2 | 82.1 | 73.4 | |
| GLM-4.5VParameters=106B2026.03 | 58.3 | 59.4 | 75.8 | 82.3 | 70.4 | 81.8 | 80.6 | 72.6 | |
| o32026.03 | 57.6 | 57.4 | 72.2 | 82.6 | 62.4 | 76.8 | 76.6 | 69.4 | |
| Qwen2.5-VL-72B-InstructParameters=72B2026.03 | 57.6 | 34.7 | 69.2 | 86.7 | 71.7 | 84.1 | 80.3 | 69.2 | |
| InternVL3.5-241B-A28B-FlashArchitecture=241B-A28B-Flash2026.03 | 57.1 | 38.6 | 59.5 | 82.1 | 64.8 | 73.9 | 68.5 | 63.5 | |
| Claude Opus 42026.03 | 54.8 | 40.6 | 65.3 | 74.9 | 59 | 75.2 | 69.3 | 62.7 | |
| Gemini 2.5 Pro2026.03 | 54.4 | 57.4 | 68 | 65.2 | 58.5 | 64.2 | 82.5 | 64.3 |