Text Classification on SST-2 (Accuracy and RDC)
0RDCBERT base
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| BERT baseParams [M]=345, Operating Point=12026.01 | 0 | 91.3 | |
| BERT baseParams [M]=345, Operating Point=22026.01 | 0 | 91.3 | |
| DistilBERTParams [M]=258, Operating Point=22026.01 | -40 | 89.9 | |
| DeeBERTParams [M]=258, Operating Point=22026.01 | -47 | 89.2 | |
| Shallow-DeepParams [M]=258, Operating Point=22026.01 | -48 | 88.4 | |
| PABEEParams [M]=258, Operating Point=22026.01 | -48 | 88.7 | |
| F-PABEEParams [M]=258, Operating Point=22026.01 | -48 | 92.3 | |
| BranchyNetParams [M]=258, Operating Point=22026.01 | -49 | 88.3 | |
| ADEPTParams [M]=42, Operating Point=22026.01 | -49 | 90.3 | |
| DistilBERTParams [M]=258, Operating Point=12026.01 | -75 | — | |
| DeeBERTParams [M]=258, Operating Point=12026.01 | -75 | — | |
| ADEPTParams [M]=42, Operating Point=12026.01 | -75 | 85.8 | |
| BranchyNetParams [M]=258, Operating Point=12026.01 | -76 | 79.9 | |
| F-PABEEParams [M]=258, Operating Point=12026.01 | -76 | 80.5 | |
| Shallow-DeepParams [M]=258, Operating Point=12026.01 | -77 | 79.5 | |
| PABEEParams [M]=258, Operating Point=12026.01 | -77 | 79.9 |