Role-playing on Alpaca-P and Character Fidelity CoSER criterion (test)
83.35Alpaca-P ScoreHumanish-Roleplay
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Humanish-RoleplayBase Model=Llama-3.1-8B-Instruct, Pruning Ratio=0%2026.06 | 83.35 | 72.37 | |
| NeekoBase Model=Llama-3.1-8B-Instruct, Pruning Ratio=0%2026.06 | 83.2 | 76.07 | |
| Persona-PrunerBase Model=Llama-3.1-8B-Instruct, Pruning Ratio=25%2026.06 | 81.86 | 78.82 | |
| LoRA fine-tuningBase Model=Llama-3.1-8B-Instruct, Pruning Ratio=0%2026.06 | 81.57 | 77.9 |