Time Series Reasoning on ETI
95AccuracyT2SP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| T2SPBackbone=Qwen-3.5-9B2026.06 | 95 | 97.4 | |
| T2SPBackbone=Gemini-3.1-flash-lite2026.06 | 93 | 96.2 | |
| Gemini-3.1-flash-liteRepresentation=Vision2026.06 | 92.5 | 96.1 | |
| T2SPBackbone=Claude-haiku-4.52026.06 | 91 | 95.5 | |
| Qwen-3.5-9BRepresentation=Vision2026.06 | 88.5 | 93.9 | |
| GPT-5.4Representation=Vision2026.06 | 88 | 93.6 | |
| ARTISTmode=+ SFT + RL2026.02 | 87.03 | 87.1 | |
| ARTISTRL=true, SFT=true2026.02 | 87.03 | — | |
| ARTISTmode=+ SFT2026.02 | 85.12 | 85.11 | |
| ARTISTSFT=true2026.02 | 85.12 | — | |
| ITFormer-4Bmode=+ SFT2026.02 | 84.62 | 84.6 | |
| T2SPBackbone=GPT-5.42026.06 | 84 | 90.9 | |
| OpenTSLM-4Bmode=+ SFT2026.02 | 82.69 | 82.66 | |
| Qwen-3.5-9BRepresentation=Raw2026.06 | 81.5 | 90.1 | |
| Gemini-3.1-flash-liteRepresentation=Raw2026.06 | 70.5 | 81.8 | |
| Claude-haiku-4.5Representation=Vision2026.06 | 68.5 | 81.3 | |
| GPT-5.4Representation=Raw2026.06 | 68 | 80.9 | |
| GPT-5statistics=w/ statistics2026.02 | 63.54 | 63.72 | |
| Claude-haiku-4.5Representation=Raw2026.06 | 56.5 | 72 | |
| ChatTS-14Bmode=+ SFT2026.02 | 50.5 | 40.69 | |
| TimeMasterRL=true2026.02 | 49 | — | |
| Qwen3-8Bstatistics=w/ statistics2026.02 | 45 | 40.88 | |
| Qwen3-14Bstatistics=w/ statistics2026.02 | 42 | 47.34 | |
| Llama-3 8Bstatistics=w/ statistics2026.02 | 35.5 | 34.39 | |
| Qwen3-14Bstatistics=w/o statistics2026.02 | 32 | 30.66 | |
| ChatTS-14Bmode=Base Model2026.02 | 31 | 21.87 | |
| GPT-5statistics=w/o statistics2026.02 | 29.5 | 27.9 | |
| VL-Time2026.02 | 28.5 | — | |
| Base Model2026.02 | 27 | — | |
| TimeMaster2026.02 | 26 | — | |
| Llama-3 8Bstatistics=w/o statistics2026.02 | 25.5 | 25.96 | |
| Qwen3-8Bstatistics=w/o statistics2026.02 | 25.25 | 24.61 | |
| Random Guess2026.02 | 25 | 25 | |
| Random Guess2026.06 | 25 | 25 | |
| VL-Timefew-shot=true2026.02 | 22 | — | |
| ChatTime-7B2026.06 | 22 | 10 |