Repetition Mitigation on NQ
11RepeatScoreDUC (Duplicatus Charm)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DUC (Duplicatus Charm)Backbone=Gemma-2-2B2025.04 | 11 | 95 | 14.72 | |
| DUC (Duplicatus Charm)Backbone=Llama-3.1-8B2025.04 | 11 | 95 | 3.97 | |
| TopPBackbone=GPT22025.04 | 13 | 93 | 82.81 | |
| DUC (Duplicatus Charm)Backbone=GPT22025.04 | 14 | 94 | 22.51 | |
| TopKBackbone=GPT22025.04 | 16 | 93 | 33.16 | |
| GreedyBackbone=Gemma-2-2B2025.04 | 18 | 92 | 5.02 | |
| GreedyBackbone=GPT22025.04 | 18 | 91 | 7.41 | |
| GreedyBackbone=Llama-3.1-8B2025.04 | 19 | 91 | 4.98 | |
| TopKBackbone=Gemma-2-2B2025.04 | 20 | 91 | 65.52 | |
| TopPBackbone=Gemma-2-2B2025.04 | 20 | 91 | 66.53 | |
| TopPBackbone=Llama-3.1-8B2025.04 | 25 | 88 | 5.35 | |
| TopKBackbone=Llama-3.1-8B2025.04 | 27 | 87 | 4.93 | |
| BeamBackbone=Llama-3.1-8B2025.04 | 36 | 82 | 3.56 | |
| BeamBackbone=Gemma-2-2B2025.04 | 47 | 77 | 87.64 | |
| BeamBackbone=GPT22025.04 | 51 | 71 | 4.39 |