Text Fluency Evaluation on AMBER
12.5PPL1Beam5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Beam5Decoding Strategy=Beam Search, Beam Size=52025.04 | 12.5 | 9.95 | 9.02 | 8.46 | |
| Beam3Decoding Strategy=Beam Search, Beam Size=32025.04 | 12.95 | 10.29 | 9.3 | 8.73 | |
| TARACDecoding Strategy=Temporal Attention Real-time Accumulative Connection2025.04 | 13.13 | 10.67 | 9.61 | 9.01 | |
| GreedyDecoding Strategy=Greedy2025.04 | 14.01 | 11.23 | 10.13 | 9.46 | |
| OPERADecoding Strategy=OPERA2025.04 | 14.13 | 11.24 | 10.19 | 9.58 | |
| DoLa(low)Decoding Strategy=Dynamic Logit Layers Aggregation, Config=low2025.04 | 14.26 | 11.46 | 10.33 | 9.64 | |
| AGLADecoding Strategy=AGLA2025.04 | 14.36 | 11.47 | 10.41 | 9.69 | |
| VCDDecoding Strategy=Visual Contrastive Decoding2025.04 | 16.2 | 12.91 | 11.7 | 10.95 | |
| DoLa(high)Decoding Strategy=Dynamic Logit Layers Aggregation, Config=high2025.04 | 17.44 | 13.82 | 12.41 | 11.57 |