Natural Language Understanding on GLUE (8-Task Suite including STS-B)
83.4MNLI AccuracyBERTbase
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| BERTbase2026.04 | 83.4 | 71.2 | 90.5 | 93.5 | 52.1 | 85.8 | 88.9 | 66.4 | 79.6 | |
| SpikeLMTime Step=42026.04 | 77.2 | 83.9 | 85.3 | 87 | 38.8 | 84.9 | 85.7 | 69 | 76.5 | |
| BERT3L2026.04 | 77.1 | 85.2 | 85.8 | 88.1 | 31.7 | 85.7 | 86.4 | 66.4 | 75.9 | |
| Adaptive Spiking NeuronTime Step=42026.04 | 75.5 | 86.1 | 82.9 | 87 | 33.5 | 45 | 79.1 | 50.9 | 67.5 | |
| SpikeBERTTime Step=42026.04 | 71 | 68.2 | 66.4 | 85.4 | 16.9 | 18.7 | 82 | 57.5 | 59.7 | |
| NILIF (WE-SpikingFormer)Time Step=42026.04 | 70.1 | 85.1 | 77.5 | 89 | 27.9 | 42.8 | 81.6 | 55.9 | 66.3 | |
| Q2BERT2026.04 | 47.3 | 67 | 61.3 | 80.6 | 0 | 4.7 | 81.2 | 52.7 | 49.1 | |
| LIF-BERTTime Step=42026.04 | 35.2 | 0 | 50.5 | 50.9 | 0 | 0 | 81.2 | 52.7 | 34.6 | |
| PSN-BERTTime Step=42026.04 | 35.2 | 0 | 50.5 | 50.9 | 0 | 6.8 | 81.2 | 52.7 | 34.7 |