Question Answering on LoCoMo (L, J Metrics)
44.6L ScoreMemLoRA-V (InternVL3-2B)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MemLoRA-V (InternVL3-2B)Backbone=InternVL3-2B, KD teacher=Gemma2-27B\InternVL3-78B2025.12 | 44.6 | 40.3 | |
| Mem0 (GPT-OSS-120B)Backbone=GPT-OSS-120B2025.12 | 38.9 | 48.9 | |
| Mem0 (Gemma2-27B)Backbone=Gemma2-27B2025.12 | 38.6 | 39.1 | |
| Mem0 (InternVL3-2B)Backbone=InternVL3-2B2025.12 | 32.2 | 27 | |
| MemLoRA-V (InternVL3-1B)Backbone=InternVL3-1B, KD teacher=Gemma2-27B\InternVL3-78B2025.12 | 29.1 | 20.2 | |
| Mem0 (InternVL3-1B)Backbone=InternVL3-1B2025.12 | 13.7 | 9 |