Text Classification on UK Key Stage dataset
99.7AccuracyELECTRA + ANN
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ELECTRA + ANNParameters=108907499, Inference Time (S)=0.0182024.11 | 99.7 | 99.7 | 99.7 | 99.6 | |
| ERNIE + ANNParameters=109499627, Inference Time (S)=0.0182024.11 | 99.5 | 99.5 | 99.5 | 99.4 | |
| XLNet + ANNParameters=116734187, Inference Time (S)=0.0252024.11 | 99.2 | 99.2 | 99.2 | 99.2 | |
| RoBERTa + ANNParameters=124661483, Inference Time (S)=0.0192024.11 | 98.7 | 98.8 | 98.7 | 98.7 | |
| DistilBERT + ANNParameters=66378731, Inference Time (S)=0.0112024.11 | 98.7 | 98.7 | 98.7 | 98.7 | |
| Longformer + ANNParameters=148675307, Inference Time (S)=0.0402024.11 | 93.9 | 95.1 | 93.9 | 93.9 | |
| BERT + ANNParameters=109498091, Inference Time (S)=0.0182024.11 | 90.5 | 90.5 | 90.5 | 90.5 | |
| BERTParameters=109485316, Inference Time (S)=0.0102024.11 | 75 | 75.1 | 75 | 75 | |
| DistilBERTParameters=66956548, Inference Time (S)=0.0062024.11 | 74.4 | 74.4 | 74.4 | 74.4 | |
| XLNetParameters=117312004, Inference Time (S)=0.0222024.11 | 74.2 | 74 | 74.2 | 74 | |
| ALBERT + ANNParameters=11699435, Inference Time (S)=0.0102024.11 | 74.1 | 86.2 | 74.1 | 79.7 | |
| LongformerParameters=148662532, Inference Time (S)=0.0362024.11 | 74.1 | 74.1 | 74.1 | 74 | |
| ERNIEParameters=109486852, Inference Time (S)=0.0112024.11 | 73.5 | 74 | 73.5 | 73.6 | |
| RoBERTaParameters=124648708, Inference Time (S)=0.0102024.11 | 73.1 | 73.1 | 73.1 | 73.1 | |
| ELECTRAParameters=109485316, Inference Time (S)=0.0112024.11 | 71.4 | 71.3 | 71.4 | 71.3 | |
| ALBERTParameters=11686660, Inference Time (S)=0.0092024.11 | 67.5 | 68.5 | 67.5 | 67.8 |