Time Series Comprehension on TimeMQA
0.5603AccuracyPATRA 7B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PATRA 7BModalities=Textual + Temporal, Backbone=Qwen2.5 7B2026.02 | 0.5603 | 0.2567 | |
| GPT-4oModalities=Textual2026.02 | 0.5086 | 0.1199 | |
| ChatTS 7BModalities=Textual + Temporal2026.02 | 0.4483 | 0.133 | |
| Qwen2.5 7BModalities=Textual2026.02 | 0.4224 | 0.1877 | |
| Deepseek-R1 7BModalities=Textual2026.02 | 0.4052 | 0.1365 | |
| ITFormer 7BModalities=Textual + Temporal2026.02 | 0.4052 | 0.1424 | |
| TimeOmni-1 7BModalities=Textual2026.02 | 0.3793 | 0.1416 | |
| Llama3 8BModalities=Textual2026.02 | 0.3362 | 0.0515 | |
| Llama3 8BModalities=Textual, Task Protocol=TimeMQA2026.02 | 0.2845 | 0.096 | |
| Mistral 7BModalities=Textual, Task Protocol=TimeMQA2026.02 | 0.1896 | 0.0963 | |
| Qwen2.5 7BModalities=Textual, Task Protocol=TimeMQA2026.02 | 0.1034 | 0.1792 |