Grammatical Error Type Identification on FCGEC (test)
73.04AccuracyHuman
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| HumanAnnotators=25, Native speaker=true2022.10 | 73.04 | 76.74 | 57.15 | 64.4 | |
| RoBERTa-LargeIndependent runs=10, Training=Fine-tuned, Epochs=4, Batch size=642022.10 | 60.04 | 59.86 | 69.28 | 64.1 | |
| MacBERT-LargeIndependent runs=10, Training=Fine-tuned, Epochs=4, Batch size=642022.10 | 57.86 | 57.29 | 63.51 | 59.76 | |
| StructBERT-LargeIndependent runs=10, Training=Fine-tuned, Epochs=4, Batch size=642022.10 | 57.86 | 60.13 | 67.98 | 62.68 | |
| BERTIndependent runs=10, Training=Fine-tuned, Epochs=4, Batch size=642022.10 | 56.53 | 56.87 | 63.15 | 59.15 | |
| RoBERTaIndependent runs=10, Training=Fine-tuned, Epochs=4, Batch size=642022.10 | 54.9 | 58.78 | 65.34 | 61.33 | |
| MacBERTIndependent runs=10, Training=Fine-tuned, Epochs=4, Batch size=642022.10 | 53.51 | 56.2 | 64.58 | 59.22 |