Repetition Mitigation on EQ
0.46RepeatScoreBeam
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BeamBackbone=GPT22025.04 | 0.46 | 0.7 | 7.66 | |
| GreedyBackbone=GPT22025.04 | 0.36 | 0.81 | 8.7 | |
| BeamBackbone=Gemma-2-2B2025.04 | 0.31 | 0.84 | 11.13 | |
| GreedyBackbone=Gemma-2-2B2025.04 | 0.28 | 0.86 | 8.53 | |
| GreedyBackbone=Llama-3.1-8B2025.04 | 0.26 | 0.88 | 16.72 | |
| BeamBackbone=Llama-3.1-8B2025.04 | 0.22 | 0.89 | 9.23 | |
| TopKBackbone=Llama-3.1-8B2025.04 | 0.19 | 0.91 | 10.46 | |
| TopPBackbone=Llama-3.1-8B2025.04 | 0.19 | 0.91 | 13.32 | |
| TopPBackbone=GPT22025.04 | 0.19 | 0.94 | 74.05 | |
| TopKBackbone=Gemma-2-2B2025.04 | 0.14 | 0.94 | 24.37 | |
| TopPBackbone=Gemma-2-2B2025.04 | 0.14 | 0.94 | 16.74 | |
| DUC (Duplicatus Charm)Backbone=Gemma-2-2B2025.04 | 0.13 | 0.94 | 17.23 | |
| DUC (Duplicatus Charm)Backbone=Llama-3.1-8B2025.04 | 0.13 | 0.91 | 10.39 | |
| TopKBackbone=GPT22025.04 | 0.13 | 0.95 | 30.47 | |
| DUC (Duplicatus Charm)Backbone=GPT22025.04 | 0.13 | 0.94 | 23.14 |