Natural Language Generation on WebNLG all categories (test)
55.27BLEUHiddenKey
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HiddenKeyBackbone=GPT2-Medium, Strategy=LoRA2024.02 | 55.27 | 0.413 | — | — | 0.386 | |
| HiddenKey-Backbone=GPT2-Medium, Strategy=LoRA2024.02 | 55.26 | 0.411 | — | — | 0.388 | |
| DropKeyBackbone=GPT2-Medium, Strategy=LoRA2024.02 | 55.22 | 0.411 | — | — | 0.389 | |
| HiddenCutBackbone=GPT2-Medium, Strategy=LoRA2024.02 | 55.06 | 0.411 | — | — | 0.391 | |
| BaselineBackbone=GPT2-Medium, Strategy=LoRA2024.02 | 54.78 | 0.411 | — | — | 0.395 | |
| BestPlanSystem Type=Rule-Based + NMT2019.04 | 47.4 | 0.391 | 63.1 | 2.692 | — | |
| StrongNeuralSystem Type=NMT2019.04 | 46.5 | 0.392 | 65.4 | 2.866 | — | |
| Full FinetuningBackbone=GPT2-Medium, Strategy=Full Finetuning2024.02 | 46.5 | 0.38 | — | — | 0.53 | |
| MelbourneSystem Type=NMT2019.04 | 45 | 0.376 | 63.5 | 2.814 | — | |
| RandomPlan-2System Type=Rule-Based + NMT2019.04 | 43.5 | 0.384 | 57.4 | 2.332 | — | |
| RandomPlan-3System Type=Rule-Based + NMT2019.04 | 43.5 | 0.384 | 57.4 | 2.303 | — | |
| RandomPlan-1System Type=Rule-Based + NMT2019.04 | 43.3 | 0.384 | 57.6 | 2.342 | — | |
| UPF-FORGESystem Type=Rule-Based2019.04 | 38.5 | 0.39 | 60.9 | 2.5 | — |