Generative Commonsense Reasoning on CommonGen V1.0 (test)
32.78BLEU-4MORE
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MOREBackbone=OPT-2.7b, Modality=multi-modal2024.02 | 32.78 | 32.15 | 57.07 | 17.03 | 32.94 | |
| MOREBackbone=T5-Large, Modality=image2024.02 | 32.37 | 31.31 | 56.6 | 16.67 | 32.31 | |
| MOREBackbone=T5-Large, Modality=multi-modal2024.02 | 32.29 | 30.9 | 56.62 | 16.63 | 32.34 | |
| MOREBackbone=T5-Large, Modality=text2024.02 | 32.03 | 31.05 | 56.14 | 16.37 | 32 | |
| BLIP-2Backbone=OPT-2.7b, Modality=multi-modal2024.02 | 31.92 | 31.7 | 56.22 | 16.73 | 32.44 | |
| OPTBackbone=OPT-2.7b2024.02 | 31.53 | 31.43 | 55.95 | 16.76 | 32.24 | |
| T5Backbone=T5-Large2024.02 | 31.16 | 30.48 | 55.68 | 16.14 | 31.62 | |
| MOREBackbone=T5-Base, Modality=multi-modal2024.02 | 30.27 | 30.28 | 55.18 | 16.02 | 31.94 | |
| MOREBackbone=T5-Base, Modality=image2024.02 | 29.98 | 30.21 | 55.07 | 15.92 | 31.63 | |
| MOREBackbone=T5-Base, Modality=text2024.02 | 29.87 | 30.15 | 55.2 | 15.79 | 31.57 | |
| T5Backbone=T5-Base2024.02 | 28.93 | 29.48 | 54.25 | 15.36 | 30.95 | |
| GPT-3.5Shots=3-shot2024.02 | 28.91 | 31.14 | 53.25 | 15.92 | 28.89 | |
| FiDBackbone=T5-Base2024.02 | 28.32 | 28.72 | 54.07 | 14.78 | 30.25 | |
| ViSCTGBackbone=T5-Base2024.02 | 27.67 | 28.82 | 53.71 | 14.77 | 30.24 | |
| PrependBackbone=T5-Base2024.02 | 26.68 | 28.43 | 53.29 | 14.39 | 29.95 | |
| GPT-3.5Shots=0-shot2024.02 | 21.44 | 28.93 | 48.8 | 13.03 | 26.69 |