Etiological Reasoning on Spatio-Temporal Synthetic Dataset 1.0 (test)
95.65AccuracySTReasoner-8B (Ours)
Evaluation results
| Method | Links | |
|---|---|---|
| STReasoner-8B (Ours)Category=Spatio-Temporal RMs, Prompting=TS Encoder, Tokens (M)=0.08, Est. Cost ($)=0.272026.01 | 95.65 | |
| Qwen3-VL-8B-Instruct - SFT+S-GRPOCategory=Open-Source Models, Prompting=Image, Tokens (M)=0.21, Est. Cost ($)=0.662026.01 | 91.79 | |
| Qwen3-VL-8B-Instruct - SFTCategory=Open-Source Models, Prompting=Image, Tokens (M)=0.21, Est. Cost ($)=0.662026.01 | 90.82 | |
| Qwen3-8B - SFT+S-GRPOCategory=Open-Source Models, Prompting=Text, Tokens (M)=0.98, Est. Cost ($)=3.852026.01 | 89.37 | |
| GPT-5.2Category=Proprietary Models, Prompting=Image, Tokens (M)=0.24, Est. Cost ($)=6.692026.01 | 86.47 | |
| GPT-5.2Category=Proprietary Models, Prompting=Text, Tokens (M)=0.66, Est. Cost ($)=22.482026.01 | 83.09 | |
| Qwen3-8B - SFTCategory=Open-Source Models, Prompting=Text, Tokens (M)=0.98, Est. Cost ($)=3.852026.01 | 82.13 | |
| Claude-4.5-SonnetCategory=Proprietary Models, Prompting=Image, Tokens (M)=0.39, Est. Cost ($)=17.482026.01 | 79.61 | |
| Claude-4.5-SonnetCategory=Proprietary Models, Prompting=Text, Tokens (M)=0.81, Est. Cost ($)=45.802026.01 | 78.64 | |
| Qwen3-VL-8B-InstructCategory=Open-Source Models, Prompting=Image, Tokens (M)=0.21, Est. Cost ($)=0.662026.01 | 68.6 | |
| Time-R1-7BCategory=Time Series RMs, Prompting=Text, Tokens (M)=0.98, Est. Cost ($)=3.852026.01 | 60.39 | |
| ChatTS-8BCategory=Time Series LMs, Prompting=TS Encoder, Tokens (M)=0.08, Est. Cost ($)=0.272026.01 | 56.52 | |
| Qwen3-8BCategory=Open-Source Models, Prompting=Text, Tokens (M)=0.98, Est. Cost ($)=3.852026.01 | 21.26 | |
| Time-MQA-7BCategory=Time Series LMs, Prompting=Text, Tokens (M)=0.98, Est. Cost ($)=3.852026.01 | 19.32 |