Correlation with human evaluation on SEEDA Fluency (E)
0.981Pearson Correlation (r)GPT-4 S (fluency)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GPT-4 S (fluency)2025.02 | 0.981 | 0.982 | |
| GPT-4 S (meaning)2025.02 | 0.976 | 0.974 | |
| IMPARAaggregation_procedure=w/ TrueSkill2025.02 | 0.969 | 0.965 | |
| SOMEaggregation_procedure=w/ TrueSkill2025.02 | 0.965 | 0.965 | |
| SOMEaggregation_procedure=w/o TrueSkill2025.02 | 0.943 | 0.969 | |
| IMPARAaggregation_procedure=w/o TrueSkill2025.02 | 0.9 | 0.978 | |
| GPT-4 E (fluency)2025.02 | 0.848 | 0.987 | |
| Scribendiaggregation_procedure=w/ TrueSkill2025.02 | 0.826 | 0.912 | |
| Scribendiaggregation_procedure=w/o TrueSkill2025.02 | 0.715 | 0.842 | |
| GREENaggregation_procedure=w/o TrueSkill2025.02 | 0.252 | 0.618 | |
| GLEU+aggregation_procedure=w/o TrueSkill2025.02 | 0.232 | 0.569 | |
| GLEU+aggregation_procedure=w/ TrueSkill2025.02 | 0.102 | 0.486 | |
| GREENaggregation_procedure=w/ TrueSkill2025.02 | -0.135 | 0.42 | |
| PTERRANTaggregation_procedure=w/ TrueSkill2025.02 | -0.288 | 0.279 | |
| ERRANTaggregation_procedure=w/ TrueSkill2025.02 | -0.374 | 0.231 | |
| PTERRANTaggregation_procedure=w/o TrueSkill2025.02 | -0.47 | 0.231 | |
| ERRANTaggregation_procedure=w/o TrueSkill2025.02 | -0.507 | 0.033 |