Status Tracking on ATOD Medium (test)
96.36Status Tracking AccuracyDeepSeek-R1
Evaluation Results
| Method | Links | |
|---|---|---|
| DeepSeek-R1Category=LLM-based, Prompting=zero-shot2026.01 | 96.36 | |
| RAGCategory=Memory-based2026.01 | 94.85 | |
| MemoryBankCategory=Memory-based2026.01 | 94.23 | |
| Claude-4-SonnetCategory=LLM-based, Prompting=zero-shot2026.01 | 93.26 | |
| Claude-3.5-SonnetCategory=LLM-based, Prompting=zero-shot2026.01 | 92.94 | |
| Claude-3.7-SonnetCategory=LLM-based, Prompting=zero-shot2026.01 | 92.47 | |
| ATOD (Ours)Category=Agentic Memory-based2026.01 | 92.31 | |
| LLM-RsumCategory=Memory-based2026.01 | 89.47 | |
| MemoChatCategory=Memory-based2026.01 | 73.88 |