Time Series Reasoning on TSQA
86.7AccuracyT2SP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| T2SPBackbone=Qwen-3.5-9B2026.06 | 86.7 | 69.4 | |
| T2SPBackbone=Gemini-3.1-flash-lite2026.06 | 85.9 | 68.3 | |
| T2SPBackbone=GPT-5.42026.06 | 85.7 | 68.6 | |
| T2SPBackbone=Claude-haiku-4.52026.06 | 85.2 | 68.1 | |
| GPT-5.4Representation=Raw2026.06 | 81.8 | 64.5 | |
| GPT-5.4Representation=Vision2026.06 | 81 | 64.6 | |
| Gemini-3.1-flash-liteRepresentation=Raw2026.06 | 76.8 | 61 | |
| Gemini-3.1-flash-liteRepresentation=Vision2026.06 | 76.6 | 60.8 | |
| Claude-haiku-4.5Representation=Raw2026.06 | 75.8 | 59.9 | |
| Qwen-3.5-9BRepresentation=Raw2026.06 | 74.5 | 57.9 | |
| Qwen-3.5-9BRepresentation=Vision2026.06 | 74.3 | 59.1 | |
| Claude-haiku-4.5Representation=Vision2026.06 | 73.2 | 58 | |
| ARTISTmode=+ SFT + RL2026.02 | 62 | 58.66 | |
| ARTISTRL=true, SFT=true2026.02 | 62 | — | |
| TimeMasterRL=true2026.02 | 61.22 | — | |
| ARTISTmode=+ SFT2026.02 | 60.06 | 57.13 | |
| ARTISTSFT=true2026.02 | 60.06 | — | |
| TimeMaster2026.02 | 58.3 | — | |
| Base Model2026.02 | 52.51 | — | |
| ChatTime-7B2026.06 | 52.1 | 51.6 | |
| ITFormer-4Bmode=+ SFT2026.02 | 49.5 | 23.62 | |
| Llama-3 8Bstatistics=w/o statistics2026.02 | 48.97 | 46.75 | |
| OpenTSLM-4Bmode=+ SFT2026.02 | 47.5 | 35.81 | |
| ChatTS-14Bmode=+ SFT2026.02 | 46.38 | 42.65 | |
| Llama-3 8Bstatistics=w/ statistics2026.02 | 44.93 | 44.12 | |
| VL-Time2026.02 | 44.93 | — | |
| ChatTS-14Bmode=Base Model2026.02 | 43.48 | 30.72 | |
| VL-Timefew-shot=true2026.02 | 38.16 | — | |
| GPT-5statistics=w/ statistics2026.02 | 35.75 | 32.24 | |
| Random Guess2026.06 | 33.3 | 33.3 | |
| GPT-5statistics=w/o statistics2026.02 | 30.92 | 27.22 | |
| Random Guess2026.02 | 29.67 | 29.67 | |
| Qwen3-14Bstatistics=w/o statistics2026.02 | 24.15 | 22.5 | |
| Qwen3-14Bstatistics=w/ statistics2026.02 | 24.15 | 22.2 | |
| Qwen3-8Bstatistics=w/ statistics2026.02 | 13.53 | 12.78 | |
| Qwen3-8Bstatistics=w/o statistics2026.02 | 11.35 | 11.02 |