Correlation with human evaluation on SEEDA-S Base
0.958Pearson Correlation (r)GPT-4 S (meaning)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GPT-4 S (meaning)2025.02 | 0.958 | 0.881 | |
| IMPARAaggregation_procedure=w/ TrueSkill2025.02 | 0.939 | 0.923 | |
| SOMEaggregation_procedure=w/ TrueSkill2025.02 | 0.932 | 0.881 | |
| GREENaggregation_procedure=w/o TrueSkill2025.02 | 0.925 | 0.881 | |
| IMPARAaggregation_procedure=w/o TrueSkill2025.02 | 0.916 | 0.902 | |
| GPT-4 S (fluency)2025.02 | 0.913 | 0.874 | |
| SOMEaggregation_procedure=w/o TrueSkill2025.02 | 0.892 | 0.867 | |
| GLEU+aggregation_procedure=w/o TrueSkill2025.02 | 0.886 | 0.902 | |
| PTERRANTaggregation_procedure=w/ TrueSkill2025.02 | 0.87 | 0.797 | |
| GLEU+aggregation_procedure=w/ TrueSkill2025.02 | 0.863 | 0.846 | |
| GREENaggregation_procedure=w/ TrueSkill2025.02 | 0.855 | 0.846 | |
| GPT-4 E (fluency)2025.02 | 0.844 | 0.86 | |
| ERRANTaggregation_procedure=w/ TrueSkill2025.02 | 0.763 | 0.706 | |
| PTERRANTaggregation_procedure=w/o TrueSkill2025.02 | 0.7 | 0.629 | |
| Scribendiaggregation_procedure=w/ TrueSkill2025.02 | 0.674 | 0.762 | |
| Scribendiaggregation_procedure=w/o TrueSkill2025.02 | 0.62 | 0.636 | |
| ERRANTaggregation_procedure=w/o TrueSkill2025.02 | 0.545 | 0.343 |