Memory Discrimination on IID-10K
0.841AccuracySAMD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SAMDIntent Setting=without Intent, Base Model=LLAMA3-8B2026.02 | 0.841 | 92.5 | 0.28 | |
| SAMDIntent Setting=with Intent, Base Model=LLAMA3-8B, GUM Module Usage=with GUM2026.02 | 0.83 | 95.7 | 0.18 | |
| SAMDIntent Setting=with Intent, Base Model=Qwen2-7B, GUM Module Usage=with GUM2026.02 | 0.825 | 93.6 | 0.18 | |
| SAMDIntent Setting=with Intent, Base Model=LLAMA3-8B, GUM Module Usage=without GUM2026.02 | 0.811 | 97.2 | 0.53 | |
| SAMDIntent Setting=without Intent, Base Model=Qwen2-7B2026.02 | 0.8 | 96.8 | 0.2 | |
| SAMDIntent Setting=with Intent, Base Model=Qwen2-7B, GUM Module Usage=without GUM2026.02 | 0.776 | 96.2 | 0.53 | |
| TiM2026.02 | 0.672 | 50.9 | 0.95 | |
| Memochat2026.02 | 0.163 | 73.1 | 1.21 | |
| SCM2026.02 | 0.104 | — | — |