Constrained Text Generation on CommonGen 500 randomly sampled data (test)
32.53BLEU-4MORE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| MOREbackbone=OPT-2.7b, retrieval augmentation=3 images, 3 texts2024.02 | 32.53 | 17.3 | 32.81 | |
| MOREbackbone=OPT-2.7b, retrieval augmentation=1 image, 1 text2024.02 | 31.81 | 17.08 | 31.81 | |
| GPT-4n-shot=3-shot2024.02 | 30 | 16.41 | 29.05 | |
| GPT-4n-shot=0-shot2024.02 | 28.53 | 16.52 | 30.53 | |
| GPT-3.5n-shot=3-shot2024.02 | 28.35 | 16.14 | 29.13 | |
| GPT-4n-shot=0-shot, length constraint=true2024.02 | 27.87 | 16.89 | 29.11 | |
| GPT-3.5n-shot=0-shot, length constraint=true2024.02 | 25.54 | 15.62 | 26.75 | |
| GPT-3.5n-shot=0-shot2024.02 | 22.97 | 13.93 | 27.25 | |
| GPT-4n-shot=0-shot, retrieval augmentation=1 image, 1 text2024.02 | 19.86 | 12.43 | 26.2 |