Roleplay Simulation on Humanual Politics
43.5Primary MetricClaude Opus 4.7
Evaluation results
| Method | Links | |
|---|---|---|
| Claude Opus 4.72026.06 | 43.5 | |
| GPT 5.52026.06 | 42 | |
| OSIM 8BModel=OSIM, Parameter Count=8B, Training Stage=Final2026.06 | 41.9 | |
| Others *2026.06 | 34.2 | |
| Qwen3 8B InstModel=Qwen3-8B-Instruct, Parameter Count=8B2026.06 | 33.2 | |
| Gemini 3.1 Pro2026.06 | 32.5 | |
| Qwen 3.6 Plus2026.06 | 31.6 | |
| Base 8BModel=Qwen3-8B-Base, Parameter Count=8B2026.06 | 17.8 | |
| OSIM 8B-MidModel=OSIM, Parameter Count=8B, Training Stage=Mid-trained2026.06 | 15.4 |