Multi-Hop Question Answering on LoCoMo Multi-Hop (test)
26.55F1 ScoreReproduced Baselines
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Reproduced BaselinesModel=GPT-oss:20b, Memory=A-mem2026.02 | 26.55 | 17.99 | 0 | |
| PoisonedRAGModel=GPT-oss:20b, Memory=A-mem2026.02 | 25.95 | 18.25 | -7.2 | |
| Reproduced BaselinesModel=Gemma3:27b, Memory=Mem02026.02 | 25.32 | 18.89 | 0 | |
| PoisonedRAGModel=Gemma3:27b, Memory=Mem02026.02 | 24.48 | 18.83 | -6.1 | |
| Reproduced BaselinesModel=Gemma3:27b, Memory=A-mem2026.02 | 22.29 | 12.83 | 0 | |
| Reproduced BaselinesModel=GPT-oss:20b, Memory=Mem02026.02 | 19.8 | 14.67 | 0 | |
| Reproduced BaselinesModel=Llama3.2:3b, Memory=Mem02026.02 | 19.51 | 13.6 | 0 | |
| Reproduced BaselinesModel=Llama3.2:3b, Memory=A-mem2026.02 | 19.5 | 13.1 | 0 | |
| PoisonedRAGModel=GPT-oss:20b, Memory=Mem02026.02 | 19.34 | 14.16 | -13.1 | |
| PoisonedRAGModel=Gemma3:27b, Memory=A-mem2026.02 | 19.1 | 12.02 | -13.4 | |
| PoisonedRAGModel=Llama3.2:3b, Memory=A-mem2026.02 | 18.46 | 12.81 | -7.1 | |
| PoisonedRAGModel=Llama3.2:3b, Memory=Mem02026.02 | 18.33 | 13.75 | -4.2 | |
| ER-MIAModel=GPT-oss:20b, Attack Size=1 Memory / Question, Memory=A-mem2026.02 | 15.28 | 11.71 | -48.4 | |
| ER-MIAModel=GPT-oss:20b, Attack Size=2 Memories / Question, Memory=A-mem2026.02 | 13.5 | 10.46 | -55.5 | |
| ER-MIAModel=Gemma3:27b, Attack Size=1 Memory / Question, Memory=Mem02026.02 | 12.59 | 11.68 | -48.4 | |
| ER-MIAModel=Llama3.2:3b, Attack Size=2 Memories / Question, Memory=A-mem2026.02 | 11.25 | 10.26 | -46.8 | |
| ER-MIAModel=Llama3.2:3b, Attack Size=1 Memory / Question, Memory=A-mem2026.02 | 11.17 | 10.24 | -40.2 | |
| ER-MIAModel=Llama3.2:3b, Attack Size=1 Memory / Question, Memory=Mem02026.02 | 10.95 | 10.07 | -44.1 | |
| ER-MIAModel=Gemma3:27b, Attack Size=2 Memories / Question, Memory=Mem02026.02 | 10.85 | 10.16 | -53.6 | |
| ER-MIAModel=Gemma3:27b, Attack Size=1 Memory / Question, Memory=A-mem2026.02 | 10.62 | 7.14 | -46.5 | |
| ER-MIAModel=GPT-oss:20b, Attack Size=1 Memory / Question, Memory=Mem02026.02 | 10.47 | 9.02 | -51.6 | |
| ER-MIAModel=Llama3.2:3b, Attack Size=2 Memories / Question, Memory=Mem02026.02 | 10.22 | 9.39 | -53 | |
| ER-MIAModel=GPT-oss:20b, Attack Size=2 Memories / Question, Memory=Mem02026.02 | 8.88 | 7.91 | -56.7 | |
| ER-MIAModel=Gemma3:27b, Attack Size=2 Memories / Question, Memory=A-mem2026.02 | 7.28 | 5.56 | -61.6 |