Natural Language Understanding on GLUE (Full Suite Reporting)
31.5CoLA ScoreLLaMA
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LLaMAEvaluation=fine-tuning, Seeds=32026.02 | 31.5 | 90.8 | 82.7 | 78.3 | 57.8 | 65.1 | 68 | 86 | 79.8 | 79.6 | 71.6 | |
| MambaEvaluation=fine-tuning, Seeds=32026.02 | 31.1 | 88.6 | 80.3 | 72.8 | 54.4 | 65.1 | 64.8 | 82.4 | 74.7 | 74.7 | 68.6 | |
| ProtoTEvaluation=fine-tuning, Seeds=32026.02 | 27.7 | 90 | 80.1 | 66.2 | 53.9 | 64.6 | 64.8 | 81.8 | 75.3 | 74.8 | 67.6 | |
| DeltaNetEvaluation=fine-tuning, Seeds=32026.02 | 13.8 | 85.8 | 80.1 | 67 | 50.9 | 65.1 | 62.6 | 80.1 | 71.1 | 71.8 | 64.5 |