Rubric Satisfaction Evaluation on ArXiv
38.1Claude-4 Sonnet ScoreGPT-5-Thinking
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-5-ThinkingMode=Thinking2025.12 | 38.1 | 60.9 | 50.2 | |
| GPT-OSS-120B2025.12 | 31.1 | 52.5 | 32.5 | |
| ML-Ft-Qwen-3-30BFine-tuned domain=ML2025.12 | 29.2 | 40.9 | 23.5 | |
| Claude-4.1-Opus2025.12 | 29.1 | 44.9 | 28.9 | |
| GPT-OSS-20B2025.12 | 29 | 44.1 | 25.8 | |
| Qwen-3-30B-A3B-ThinkingMode=Thinking2025.12 | 28.4 | 35.9 | 19.4 | |
| Arxiv-Ft-Qwen-3-30BFine-tuned domain=ArXiv2025.12 | 27.9 | 40 | 23.8 | |
| Med-Ft-Qwen-3-30BFine-tuned domain=Medical2025.12 | 27.6 | 42 | 26.6 | |
| Claude-4-Sonnet2025.12 | 26.2 | 41.2 | 25 | |
| Grok-42025.12 | 25.8 | 41.5 | 25.4 | |
| Qwen-3-30B-A3B2025.12 | 24.1 | 37.5 | 20.4 | |
| Grok-4-FastSpeed=Fast2025.12 | 23.2 | 42.8 | 24.7 | |
| Gemini-2.5-Pro2025.12 | 22.7 | 43.9 | 25 | |
| Qwen-3-4B-ThinkingMode=Thinking2025.12 | 17.5 | 25.5 | 12.2 | |
| Qwen-3-4B2025.12 | 16.1 | 28.1 | 12.8 | |
| Gemma-3-27B2025.12 | 15.8 | 33.2 | 14.8 | |
| Llama-4-Maverick2025.12 | 8.3 | 21.6 | 9.7 | |
| Gemma-3-4B2025.12 | 7.5 | 21.2 | 7.1 | |
| Llama-3.3-70B2025.12 | 6.3 | 18.1 | 7 | |
| Llama-4-Scout2025.12 | 5 | 14.4 | 6 | |
| Llama-3.1-8B2025.12 | 3.5 | 11.3 | 3.6 |