Question Answering on LoCOMO (Performance and System Metrics)
64.5MHFull-context
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Full-contextBackbone=QWEN3-8B, Extra=02026.06 | 64.5 | 54.2 | 36.1 | 88.6 | 71.1 | 0 | 20,626 | 2,900.5 | 21,370.3 | 3.43 | |
| RAGBackbone=QWEN3-8B, Extra=02026.06 | 47.2 | 36.5 | 23.1 | 65.4 | 51.42 | 0 | 4,232.57 | 595.2 | 16,663.8 | 2.85 | |
| Prompt Tun.Backbone=QWEN3-8B, Extra=20M2026.06 | 31.9 | 29.2 | 12.8 | 39.4 | 31.88 | 20 | 495.2 | 69.6 | 15,817.7 | 0.87 | |
| LPMBackbone=QWEN3-8B, Extra=0.65M2026.06 | 31.2 | 45.8 | 10.9 | 41 | 33.25 | 0.65 | 45.2 | 15.3 | 18,835.5 | 1.19 | |
| LoRABackbone=QWEN3-8B, Extra=77M2026.06 | 30.8 | 33.3 | 7.7 | 43.5 | 33.12 | 77 | 45.2 | 6.4 | 15,676.9 | 3.53 |