Question Answering on LongMemEval (100-question sample)
68AccuracyPACMS
Evaluation results
| Method | Links | |
|---|---|---|
| PACMSReader=GPT-5.4-mini, Redundancy level (R)=2, Budget=45%2026.06 | 68 | |
| top-kReader=GPT-5.4-mini, Redundancy level (R)=2, Budget=45%2026.06 | 64 | |
| lc-mmrReader=GPT-5.4-mini, Redundancy level (R)=2, Budget=45%2026.06 | 56 | |
| PACMSReader=GPT-5-mini, Redundancy level (R)=2, Budget=45%2026.06 | 52 | |
| top-kReader=GPT-5-mini, Redundancy level (R)=2, Budget=45%2026.06 | 50 | |
| lc-mmrReader=GPT-5-mini, Redundancy level (R)=2, Budget=45%2026.06 | 44 | |
| last-kReader=GPT-5-mini, Redundancy level (R)=2, Budget=45%2026.06 | 44 | |
| last-kReader=GPT-5.4-mini, Redundancy level (R)=2, Budget=45%2026.06 | 42 |