List your company
ResearchFormerly WizWand

Correlation with human evaluation on SEEDA-S Base

0.958Pearson Correlation (r)GPT-4 S (meaning)
0.528480.639990.75150.86301Feb 13, 2025
Updated 8mo ago

Evaluation results

MethodLinks
GPT-4 S (meaning)2025.020.9580.881
IMPARAaggregation_procedure=w/ TrueSkill2025.020.9390.923
SOMEaggregation_procedure=w/ TrueSkill2025.020.9320.881
GREENaggregation_procedure=w/o TrueSkill2025.020.9250.881
IMPARAaggregation_procedure=w/o TrueSkill2025.020.9160.902
GPT-4 S (fluency)2025.020.9130.874
SOMEaggregation_procedure=w/o TrueSkill2025.020.8920.867
GLEU+aggregation_procedure=w/o TrueSkill2025.020.8860.902
PTERRANTaggregation_procedure=w/ TrueSkill2025.020.870.797
GLEU+aggregation_procedure=w/ TrueSkill2025.020.8630.846
GREENaggregation_procedure=w/ TrueSkill2025.020.8550.846
GPT-4 E (fluency)2025.020.8440.86
ERRANTaggregation_procedure=w/ TrueSkill2025.020.7630.706
PTERRANTaggregation_procedure=w/o TrueSkill2025.020.70.629
Scribendiaggregation_procedure=w/ TrueSkill2025.020.6740.762
Scribendiaggregation_procedure=w/o TrueSkill2025.020.620.636
ERRANTaggregation_procedure=w/o TrueSkill2025.020.5450.343