List your company
ResearchFormerly WizWand

Commonsense Plausibility Estimation (Attribute Ranking) on CoDa

62.87Spearman's ρEVA-CLIP
7.95822.21436.4750.726Feb 19, 2025
Updated 6mo ago

Evaluation results

MethodLinks
EVA-CLIPInference Parameters=695M, Model Category=VLM, Method Framework=ComPaSS2025.0262.87
Qwen2_w/ CLInference Parameters=7B, Model Category=LM, Method Framework=ComPaSS, Contrastive Learning=Yes2025.0259.16
VERA-T5Inference Parameters=5B, Model Category=CSM, Method Framework=Baseline2025.0258.93
Mistral_w/ CLInference Parameters=7B, Model Category=LM, Method Framework=ComPaSS, Contrastive Learning=Yes2025.0258.54
CLIPInference Parameters=124M, Model Category=VLM, Method Framework=ComPaSS2025.0258.1
Qwen2+verbal.Inference Parameters=7B, Model Category=LM, Evaluation Method=Verbalization, Method Framework=Baseline2025.0257.4
Mistral+likelihoodInference Parameters=7B, Model Category=LM, Evaluation Method=Likelihood, Method Framework=Baseline2025.0251.3
Qwen2+likelihoodInference Parameters=7B, Model Category=LM, Evaluation Method=Likelihood, Method Framework=Baseline2025.0250.25
Qwen2_w/ CL+likelihoodInference Parameters=7B, Model Category=LM, Evaluation Method=Likelihood, Method Framework=Baseline, Contrastive Learning=Yes2025.0249.65
Mistral+verbal.Inference Parameters=7B, Model Category=LM, Evaluation Method=Verbalization, Method Framework=Baseline2025.0246.64
RoBERTa_w/ CLInference Parameters=355M, Model Category=LM, Method Framework=ComPaSS, Contrastive Learning=Yes2025.0244.59
RoBERTa+likelihoodInference Parameters=355M, Model Category=LM, Evaluation Method=Likelihood, Method Framework=Baseline2025.0224.37
RoBERTa_w/ CL+likelihoodInference Parameters=355M, Model Category=LM, Evaluation Method=Likelihood, Method Framework=Baseline, Contrastive Learning=Yes2025.0223.36
COMET-AtomicInference Parameters=440M, Model Category=CSM, Method Framework=Baseline2025.0222.91
ACCENTInference Parameters=440M, Model Category=CSM, Method Framework=Baseline2025.0210.07