Mental Model Tracking on Grounded Task-based Dialogue (D6)
0.197Normalized Discrepancy Score (S_m,d)Claude Sonnet 4
Evaluation Results
| Method | Links | |
|---|---|---|
| Claude Sonnet 42025.09 | 0.197 | |
| Human2025.09 | 0.585 | |
| Gemma 8.5B2025.09 | 0.873 | |
| o3-mini2025.09 | 0.897 |
Loading the SOTA2 catalog…