Formality Style Transfer on GYAFC Family & Relationships 1.0 (test)
0.799BLEUChawla's
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Chawla's2021.05 | 0.799 | 0.302 | 91 | 0.851 | |
| BART large + SC & BLEUTraining Domain Context=Combined (F&R and E&M), Model Architecture=BART large2021.05 | 0.793 | 0.324 | 92 | 0.852 | |
| BART + SC & BLEUTraining Domain Context=Combined (F&R and E&M), Model Architecture=BART2021.05 | 0.777 | 0.27 | 91.2 | 0.839 | |
| BART + SC & BLEUTraining Domain Context=Single domain (F&R), Model Architecture=BART2021.05 | 0.77 | 0.271 | 89.7 | 0.829 | |
| GPT-CATTraining Domain Context=Combined (E&M and F&R), Model Architecture=GPT-22021.05 | 0.769 | — | — | — | |
| BART large + SC & BLEUTraining Data Volume=100%, Training Domain Context=Combined Domains, Model Architecture=BART large2021.05 | 0.611 | 0.1 | 90 | 0.728 | |
| BART + SC & BLEUTraining Data Volume=10%, Model Architecture=BART2021.05 | 0.572 | 0.038 | 91.5 | 0.704 | |
| BART + SC & BLEUTraining Data Volume=100%, Model Architecture=BART2021.05 | 0.571 | 0.039 | 83.3 | 0.678 | |
| BART + SC & BLEUTraining Data Volume=10% Parallel Training Data, Model Architecture=BART2021.05 | 0.571 | — | — | — | |
| Bi-directional FTTraining Domain Context=Combined Domains2021.05 | 0.568 | 0.037 | 83.9 | 0.677 | |
| GPT-2 + SC & BLEUTraining Data Volume=100%, Model Architecture=GPT-22021.05 | 0.528 | -0.027 | 84.9 | 0.651 | |
| GPT-2 + SC & BLEUTraining Data Volume=10%, Model Architecture=GPT-22021.05 | 0.527 | -0.089 | 79.8 | 0.635 | |
| NMT-CombinedModel Architecture=Transformer2021.05 | 0.477 | -0.304 | 78.9 | 0.595 | |
| OpenNMT + SC & BLEUTraining Data Volume=100%, Model Architecture=OpenNMT2021.05 | 0.403 | -0.42 | 80.4 | 0.537 | |
| CPLSTraining Data Volume=10% Parallel Training Data2021.05 | 0.379 | — | — | — |