List your company

Formality Style Transfer on GYAFC Entertainment & Music 1.0 (test)

0.274BLEURTBART large + SC & BLEU
-0.96672-0.64461-0.3225-0.00039May 14, 2021

Evaluation results

MethodLinks
BART large + SC & BLEUTraining Domain Context=Combined (E&M and F&R), Model Architecture=BART large2021.050.2740.76592.90.839
Chawla's2021.050.260.762910.829
BART + SC & BLEUTraining Domain Context=Combined (E&M and F&R), Model Architecture=BART2021.050.2360.74593.70.83
BART + SC & BLEUTraining Domain Context=Single domain (E&M), Model Architecture=BART2021.050.2180.7388.70.801
GPT-CATTraining Domain Context=Combined (E&M and F&R), Model Architecture=GPT-22021.050.1760.72587.60.793
BART large + SC & BLEUTraining Data Volume=100%, Training Domain Context=Combined Domains, Model Architecture=BART large2021.050.0780.59690.50.719
BART + SC & BLEUTraining Data Volume=100%, Model Architecture=BART2021.050.0440.57785.90.69
Bi-directional FTTraining Domain Context=Combined Domains2021.050.0230.55481.80.661
GPT-2 + SC & BLEUTraining Data Volume=100%, Model Architecture=GPT-22021.05-0.0070.54292.30.683
BART + SC & BLEUTraining Data Volume=10%, Model Architecture=BART2021.05-0.030.54785.50.667
GPT-2 + SC & BLEUTraining Data Volume=10%, Model Architecture=GPT-22021.05-0.0580.49579.90.611
BART + SC & BLEUTraining Data Volume=100%, Evaluation Protocol=Evaluated against first reference only, Model Architecture=BART2021.05-0.0890.30685.90.448
NMT-CombinedModel Architecture=Transformer2021.05-0.10.50179.70.615
TS->CPEvaluation Protocol=Evaluated against first reference only2021.05-0.7060.29259.60.392
OpenNMT + SC & BLEUTraining Data Volume=10%, Model Architecture=OpenNMT2021.05-0.9190.23188.60.366