PRP Faithfulness Evaluation on Alice original characters 8 persona statements
2.9ΔAPC (DeB)Retrieval-augmented Generation (RAG)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Retrieval-augmented Generation (RAG)CPO (APC-based DPO)=True2024.05 | 2.9 | 2.2 | 7.6 | |
| Retrieval-augmented Generation (RAG)CPO (APC-based DPO)=False2024.05 | 2.8 | 1.8 | 6.8 | |
| Long-context Memory (LCM)CPO (APC-based DPO)=True2024.05 | 2.8 | 2.2 | 7.6 | |
| Experience Upload (EU)CPO (APC-based DPO)=True2024.05 | 2.7 | 1.4 | 6.8 | |
| Experience Upload (EU)CPO (APC-based DPO)=False2024.05 | 2.6 | 1.1 | 6.4 | |
| Long-context Memory (LCM)CPO (APC-based DPO)=False2024.05 | 2.6 | 1.4 | 6.8 | |
| Gemma-7BCPO (APC-based DPO)=False2024.05 | 0.7 | 0.3 | 1.8 |