Memory Discrimination on BID-20K
86AccSAMD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SAMDIntent Setting=without Intent, Base Model=LLAMA3-8B2026.02 | 86 | 97.2 | 0.96 | |
| SAMDIntent Setting=with Intent, Base Model=Qwen2-7B, GUM Module Usage=with GUM2026.02 | 85.4 | 89.5 | 0.45 | |
| SAMDIntent Setting=with Intent, Base Model=LLAMA3-8B, GUM Module Usage=with GUM2026.02 | 85.1 | 92.1 | 0.43 | |
| SAMDIntent Setting=with Intent, Base Model=Qwen2-7B, GUM Module Usage=without GUM2026.02 | 80.9 | 90.9 | 0.55 | |
| SAMDIntent Setting=with Intent, Base Model=LLAMA3-8B, GUM Module Usage=without GUM2026.02 | 80.5 | 92.3 | 0.54 | |
| SAMDIntent Setting=without Intent, Base Model=Qwen2-7B2026.02 | 80.4 | 99.6 | 0.98 | |
| Memochat2026.02 | 65.6 | 68.4 | 1.39 | |
| SCM2026.02 | 54.4 | — | — | |
| TiM2026.02 | 48.6 | 50.2 | 1.26 |