List your company

Generative Commonsense Reasoning on CommonGen V1.0 (test)

32.78BLEU-4MORE
20.986424.048227.1130.1718Feb 21, 2024

Evaluation results

MethodLinks
MOREBackbone=OPT-2.7b, Modality=multi-modal2024.0232.7832.1557.0717.0332.94
MOREBackbone=T5-Large, Modality=image2024.0232.3731.3156.616.6732.31
MOREBackbone=T5-Large, Modality=multi-modal2024.0232.2930.956.6216.6332.34
MOREBackbone=T5-Large, Modality=text2024.0232.0331.0556.1416.3732
BLIP-2Backbone=OPT-2.7b, Modality=multi-modal2024.0231.9231.756.2216.7332.44
OPTBackbone=OPT-2.7b2024.0231.5331.4355.9516.7632.24
T5Backbone=T5-Large2024.0231.1630.4855.6816.1431.62
MOREBackbone=T5-Base, Modality=multi-modal2024.0230.2730.2855.1816.0231.94
MOREBackbone=T5-Base, Modality=image2024.0229.9830.2155.0715.9231.63
MOREBackbone=T5-Base, Modality=text2024.0229.8730.1555.215.7931.57
T5Backbone=T5-Base2024.0228.9329.4854.2515.3630.95
GPT-3.5Shots=3-shot2024.0228.9131.1453.2515.9228.89
FiDBackbone=T5-Base2024.0228.3228.7254.0714.7830.25
ViSCTGBackbone=T5-Base2024.0227.6728.8253.7114.7730.24
PrependBackbone=T5-Base2024.0226.6828.4353.2914.3929.95
GPT-3.5Shots=0-shot2024.0221.4428.9348.813.0326.69