Grammatical Error Correction on BEA (dev)
71.7Precision (%)AGGR-RANK
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AGGR-RANKEnsemble Components=GPT-4-rank-a(clust 3), majority-voting(best 7)2024.04 | 71.7 | 41.7 | 62.7 | |
| AGGR-RANK*Ensemble Components=GPT-4-rank-a(clust 3), GRECO-rank-w(best 7), Optimized for test dataset=true2024.04 | 68.3 | 45.1 | 61.9 | |
| EditScorer2024.04 | 67.3 | 36.1 | 57.4 | |
| GECTOR-2024fine-tuned=true2024.04 | 64.6 | 37.2 | 56.3 | |
| T5-11Bfine-tuned=true2024.04 | 60.9 | 51.1 | 58.6 | |
| UL2-20Bfine-tuned=true2024.04 | 60.5 | 48.6 | 57.7 | |
| Chat-LLaMa-2-13Bfine-tuned=true2024.04 | 59.8 | 46.1 | 56.4 | |
| Chat-LLaMa-2-7Bfine-tuned=true2024.04 | 58.3 | 46 | 55.3 | |
| CTC-Copy2024.04 | 58.3 | 38 | 52.7 | |
| GPT-4zero-shot=true2024.04 | 42.5 | 45 | 43 | |
| GPT-3.5zero-shot=true2024.04 | 37.4 | 50.6 | 39.4 | |
| GPT-3.5zero-shot=true, chain-of-thought=true2024.04 | 36.4 | 50.8 | 38.5 | |
| Chat-LLaMa-2-13Bzero-shot=true2024.04 | 30.6 | 45 | 32.7 | |
| Chat-LLaMa-2-7Bzero-shot=true2024.04 | 19.1 | 34.1 | 21 |