Conversational Question Answering on LoCoMo
44.5L MetricMemLoRA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MemLoRALLM=Gemma2-2B, KD teacher=Gemma2-27B2025.12 | 44.5 | 47.2 | 90 | |
| MemLoRALLM=Gemma2-2B, KD teacher=GPT-OSS-120B2025.12 | 42.7 | 44.6 | 79 | |
| Mem0LLM=GPT-OSS-120B2025.12 | 38.9 | 48.9 | — | |
| Mem0LLM=Gemma2-27B2025.12 | 38.6 | 39.1 | — | |
| MemLoRALLM=Qwen2.5-1.5B, KD teacher=GPT-OSS-120B2025.12 | 38.4 | 42.1 | 42 | |
| MemLoRALLM=Qwen2.5-1.5B, KD teacher=Gemma2-27B2025.12 | 37.3 | 36.9 | 25 | |
| Mem0LLM=Qwen2.5-1.5B2025.12 | 30.5 | 29.6 | — | |
| Mem0LLM=Gemma2-2B2025.12 | 29.1 | 24.9 | — |