Temporal Reasoning (time_of_day) on Synthetic Temporal Dataset 10-fold CV
1.14Log LossQwen2.5-3B-IT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5-3B-ITManifold=circ2025.10 | 1.14 | 19 | |
| gemma-2-2b-ITManifold=semic2025.10 | 1.256 | 7 | |
| Llama-3.2-3B-ITManifold=circ2025.10 | 1.278 | 30 | |
| Llama-3.2-3BManifold=circ2025.10 | 1.284 | 10 | |
| Qwen2.5-3BManifold=circ2025.10 | 1.287 | 24 | |
| Llama-3.1-8B-ITManifold=circ2025.10 | 1.298 | 12 | |
| Llama-3.1-70B-ITManifold=circ2025.10 | 1.482 | 53 | |
| gemma-2-2bManifold=circ2025.10 | 1.507 | 18 |