Unconditional Text Generation on Unconditional Text Generation
47.46BLEUCoM-DAD (large)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CoM-DAD (large)Method Category=Diffusion-based Methods, Pretrained=false, Training Steps=400K+300K, Inference Iterations=20, Output Length=2562026.01 | 47.46 | 16.52 | |
| DiffusionBERTMethod Category=Diffusion-based Methods, Pretrained=false, Training Steps=1.9M, Inference Iterations=128, Output Length=1282026.01 | 43.58 | 21.51 | |
| D3PMMethod Category=Diffusion-based Methods, Pretrained=false, Training Steps=1M, Inference Iterations=128, Output Length=1282026.01 | 42.41 | 22.88 | |
| Diffusion-LMMethod Category=Diffusion-based Methods, Pretrained=false, Training Steps=740K, Inference Iterations=2000, Output Length=642026.01 | 35.53 | 26.68 | |
| CoM-DAD (base)Method Category=Diffusion-based Methods, Pretrained=false, Training Steps=400K+300K, Inference Iterations=20, Output Length=2562026.01 | 29.42 | 18.37 | |
| BERT-MouthMethod Category=Diffusion-based Methods, Pretrained=true, Training Steps=2.8M, Inference Iterations=10, Output Length=502026.01 | 28.67 | 12.4 | |
| CoM-DAD (large) + AutoregressiveMethod Category=Autoregressive Prediction, Pretrained=false, Training Steps=400K+300K, Inference Iterations=20, Output Length=2562026.01 | 13.64 | 16.52 | |
| GPT-2Method Category=Autoregressive Prediction, Pretrained=true, Training Steps=1M, Inference Iterations=40, Output Length=402026.01 | 10.81 | 40.02 | |
| CoM-DAD (base) + AutoregressiveMethod Category=Autoregressive Prediction, Pretrained=false, Training Steps=400K+300K, Inference Iterations=20, Output Length=2562026.01 | 8.52 | 18.37 | |
| BERT (base)Method Category=Autoregressive Prediction, Pretrained=true, Training Steps=1M, Inference Iterations=40, Output Length=402026.01 | 7.8 | 10.06 | |
| BERT (large)Method Category=Autoregressive Prediction, Pretrained=true, Training Steps=1M, Inference Iterations=40, Output Length=402026.01 | 5.05 | 9.43 |