Data Prediction on DSPredict Easy (test)
100Validation RateGPT-5.1
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-5.1reasoning=high2026.01 | 100 | 60.4 | 75 | |
| Claude Sonnet 4.52026.01 | 100 | 49 | 52.8 | |
| Claude Sonnet 42026.01 | 100 | 44.4 | 36.1 | |
| GPT-5.1reasoning=none2026.01 | 97.2 | 45.7 | 41.7 | |
| Qwen3 Instructparameters=235B2026.01 | 97.2 | 42.9 | 33.3 | |
| Kimi K2 Instruct2026.01 | 97.2 | 43.9 | 41.7 | |
| GPT-5.1reasoning=medium2026.01 | 91.7 | 55.7 | 63.9 | |
| Deepseek v3.12026.01 | 86.8 | 30.9 | 7.9 | |
| Qwen3-Coderparameters=480B2026.01 | 86.5 | 42.9 | 33.3 | |
| GPT-5reasoning=medium2026.01 | 75 | 53.5 | 52.8 | |
| Qwen3 Instructparameters=4B2026.01 | 67.6 | 28.2 | 5.4 | |
| Qwen2.5 Instructparameters=7B2026.01 | 35.1 | 17.5 | 0 |