Repetition Mitigation on AQ
0.53RepeatScoreBeam
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BeamBackbone=GPT22025.04 | 0.53 | 0.75 | 6.88 | |
| BeamBackbone=Llama-3.1-8B2025.04 | 0.52 | 0.76 | 8.6 | |
| TopKBackbone=Llama-3.1-8B2025.04 | 0.36 | 0.84 | 11.89 | |
| BeamBackbone=Gemma-2-2B2025.04 | 0.35 | 0.84 | 85.4 | |
| TopPBackbone=Llama-3.1-8B2025.04 | 0.35 | 0.84 | 10.42 | |
| GreedyBackbone=GPT22025.04 | 0.25 | 0.88 | 8.7 | |
| GreedyBackbone=Gemma-2-2B2025.04 | 0.22 | 0.89 | 54.14 | |
| GreedyBackbone=Llama-3.1-8B2025.04 | 0.21 | 0.9 | 14.62 | |
| TopKBackbone=GPT22025.04 | 0.21 | 0.91 | 31 | |
| TopPBackbone=Gemma-2-2B2025.04 | 0.17 | 0.93 | 60.79 | |
| TopPBackbone=GPT22025.04 | 0.17 | 0.93 | 55.27 | |
| TopKBackbone=Gemma-2-2B2025.04 | 0.16 | 0.93 | 61.79 | |
| DUC (Duplicatus Charm)Backbone=GPT22025.04 | 0.14 | 0.94 | 14.53 | |
| DUC (Duplicatus Charm)Backbone=Llama-3.1-8B2025.04 | 0.11 | 0.93 | 11.17 | |
| DUC (Duplicatus Charm)Backbone=Gemma-2-2B2025.04 | 0.1 | 0.96 | 8.84 |