Goal Detection on ATOD Complex (test)
89.13Goal Detection F1LLM-Rsum
Evaluation results
| Method | Links | |
|---|---|---|
| LLM-RsumCategory=Memory-based2026.01 | 89.13 | |
| RAGCategory=Memory-based2026.01 | 87.13 | |
| ATOD (Ours)Category=Agentic Memory-based2026.01 | 86.49 | |
| Claude-3.5-SonnetCategory=LLM-based, Prompting=zero-shot2026.01 | 82.92 | |
| MemoryBankCategory=Memory-based2026.01 | 76.86 | |
| Claude-4-SonnetCategory=LLM-based, Prompting=zero-shot2026.01 | 75.58 | |
| Claude-3.7-SonnetCategory=LLM-based, Prompting=zero-shot2026.01 | 72.97 | |
| MemoChatCategory=Memory-based2026.01 | 58.07 | |
| DeepSeek-R1Category=LLM-based, Prompting=zero-shot2026.01 | 36.63 |