Content Fluency on Harry Potter
4Fluency MeanOriginal
Evaluation results
| Method | Links | |
|---|---|---|
| OriginalBase Model=Llama-2-7B2026.03 | 4 | |
| OursBase Model=Llama-2-7B2026.03 | 3.3 | |
| KLBase Model=Llama-2-7B2026.03 | 3.1 | |
| NPOBase Model=Llama-2-7B2026.03 | 2.9 | |
| RetainBase Model=Llama-2-7B2026.03 | 2.8 | |
| ELMBase Model=Llama-2-7B2026.03 | 2.8 | |
| WHPBase Model=Llama-2-7B2026.03 | 2.5 | |
| LoRABase Model=Llama-2-7B2026.03 | 2.3 | |
| A-LoRABase Model=Llama-2-7B2026.03 | 2.3 | |
| Fine-tuneBase Model=Llama-2-7B2026.03 | 1.9 | |
| GDBase Model=Llama-2-7B2026.03 | 1.8 | |
| GABase Model=Llama-2-7B2026.03 | 1 |