Natural Language Understanding on GLUE (SST-2 Performance and Average)
92.9SST-2 AccuracyFull-Rank (BERT/GPT)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Full-Rank (BERT/GPT)FLOPs (x10^9)=8.22025.12 | 92.9 | 88.4 | |
| DR-RLFLOPs (x10^9)=4.82025.12 | 92.8 | 88.1 | |
| NyströmformerFLOPs (x10^9)=4.92025.12 | 90.4 | 86.1 | |
| PerformerFLOPs (x10^9)=4.72025.12 | 89.1 | 85.2 | |
| Fixed RankFLOPs (x10^9)=4.9, r=322025.12 | 88.7 | 84.8 |