Time Series Reasoning on TSUR Reasoning (test)
58.73Inductive AccuracyGEM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GEMType=Num.+Visual2026.01 | 58.73 | 67.44 | 66.3 | 53 | 59.3 | |
| MADIType=Num.+Visual2026.01 | 57.68 | 67.44 | 76.09 | 62 | 61.98 | |
| ChatTSType=Numerical2026.01 | 55.66 | 51.16 | 58.7 | 53 | 55.5 | |
| ChatTimeType=Numerical2026.01 | 49.18 | 48.84 | 53.26 | 44 | 49.07 | |
| InstructTimeType=Numerical2026.01 | 47.02 | 53.49 | 50 | 52 | 48.25 | |
| ITFormerType=Numerical2026.01 | 42.54 | 44.19 | 47.83 | 46 | 43.48 | |
| Gemini 3 ProType=Visual2026.01 | 36.57 | 62.79 | 70.65 | 68 | 43.87 | |
| Gemini 3 ProType=Numerical2026.01 | 34.46 | 46.51 | 63.04 | 68 | 40.9 | |
| DeepSeek-V3.2Type=Numerical2026.01 | 33.66 | 69.77 | 72.83 | 56 | 40.99 | |
| Qwen3-VLType=Visual2026.01 | 33.11 | 51.16 | 60.87 | 55 | 38.75 | |
| Qwen3Type=Numerical2026.01 | 32.38 | 48.84 | 68.48 | 46 | 37.93 | |
| GPT-5.2Type=Visual2026.01 | 32.09 | 51.16 | 67.39 | 51 | 37.93 | |
| GPT-4oType=Numerical2026.01 | 32.07 | 60.47 | 66.3 | 49 | 38.22 | |
| GPT-5.2Type=Numerical2026.01 | 30.32 | 0 | 73.91 | 43 | 34.23 | |
| Gemini 3 ProType=Num.+Visual2026.01 | 30.12 | 53.49 | 58.7 | 69 | 37.49 | |
| GPT-5.2Type=Num.+Visual2026.01 | 29.93 | 34.88 | 75 | 46 | 35.74 | |
| Qwen3-VLType=Num.+Visual2026.01 | 29.7 | 51.16 | 69.57 | 54 | 36.76 | |
| GPT-4oType=Visual2026.01 | 28.86 | 62.79 | 68.48 | 51 | 36.03 | |
| GPT-4oType=Num.+Visual2026.01 | 26.81 | 55.81 | 69.57 | 47 | 33.93 |