Text Classification on GLUE (SST-2, MNLI, QNLI, QQP)
94.1AccuracyDP-LoRA
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DP-LoRAModel=Large, Step Milestone=400, Task=SST-22025.10 | 94.1 | 94.1 | — | — | — | — | — | |
| SVD DenoisingModel=Large, Step Milestone=400, Task=SST-22025.10 | 94.1 | 94.1 | — | — | — | 15.6 | 0.49 | |
| SVD DenoisingModel=Large, Step Milestone=200, Task=SST-22025.10 | 93.1 | 93.1 | — | — | — | 62.5 | 1.47 | |
| SVD DenoisingModel=Base, Step Milestone=400, Task=SST-22025.10 | 92.1 | 92.1 | — | — | — | 17.5 | 0.55 | |
| DP-LoRAModel=Base, Step Milestone=400, Task=SST-22025.10 | 91.8 | 91.8 | — | — | — | — | — | |
| SVD DenoisingModel=Base, Step Milestone=200, Task=SST-22025.10 | 90.8 | 90.8 | — | — | — | 27.3 | 0.57 | |
| DP-LoRAModel=Large, Step Milestone=400, Task=QNLI2025.10 | 88.8 | — | — | 88.8 | — | — | — | |
| SVD DenoisingModel=Large, Step Milestone=400, Task=QNLI2025.10 | 88.4 | — | — | 88.4 | — | — | — | |
| DP-LoRAModel=Base, Step Milestone=200, Task=SST-22025.10 | 87.9 | 87.9 | — | — | — | — | — | |
| SVD DenoisingModel=Large, Step Milestone=400, Task=MNLI2025.10 | 86 | — | 86 | — | — | 19.3 | 0.3 | |
| DP-LoRAModel=Large, Step Milestone=400, Task=MNLI2025.10 | 85.3 | — | 85.3 | — | — | — | — | |
| SVD DenoisingModel=Large, Step Milestone=200, Task=QNLI2025.10 | 85.1 | — | — | 85.1 | — | 21.7 | 0.39 | |
| SVD DenoisingModel=Large, Step Milestone=400, Task=QQP2025.10 | 84.7 | — | — | — | 84.7 | 27.9 | 0.45 | |
| SVD DenoisingModel=Base, Step Milestone=400, Task=QNLI2025.10 | 84.4 | — | — | 84.4 | — | 40.7 | 1.17 | |
| DP-LoRAModel=Large, Step Milestone=400, Task=QQP2025.10 | 84 | — | — | — | 84 | — | — | |
| DP-LoRAModel=Large, Step Milestone=200, Task=QNLI2025.10 | 83.2 | — | — | 83.2 | — | — | — | |
| SVD DenoisingModel=Base, Step Milestone=400, Task=QQP2025.10 | 83.2 | — | — | — | 83.2 | 47.9 | 0.83 | |
| SVD DenoisingModel=Large, Step Milestone=200, Task=QQP2025.10 | 82.8 | — | — | — | 82.8 | 35 | 0.41 | |
| SVD DenoisingModel=Base, Step Milestone=200, Task=QQP2025.10 | 81.7 | — | — | — | 81.7 | 43.7 | 0.53 | |
| DP-LoRAModel=Base, Step Milestone=400, Task=QQP2025.10 | 81.7 | — | — | — | 81.7 | — | — | |
| DP-LoRAModel=Base, Step Milestone=400, Task=QNLI2025.10 | 80.7 | — | — | 80.7 | — | — | — | |
| SVD DenoisingModel=Base, Step Milestone=400, Task=MNLI2025.10 | 79.9 | — | 79.9 | — | — | 34.5 | 0.56 | |
| SVD DenoisingModel=Large, Step Milestone=200, Task=MNLI2025.10 | 78.8 | — | 78.8 | — | — | 15.6 | 0.17 | |
| SVD DenoisingModel=Base, Step Milestone=200, Task=QNLI2025.10 | 78.3 | — | — | 78.3 | — | 75 | 1.64 | |
| DP-LoRAModel=Base, Step Milestone=400, Task=MNLI2025.10 | 77 | — | 77 | — | — | — | — | |
| DP-LoRAModel=Large, Step Milestone=200, Task=QQP2025.10 | 75.8 | — | — | — | 75.8 | — | — | |
| SVD DenoisingModel=Base, Step Milestone=200, Task=MNLI2025.10 | 71.1 | — | 71.1 | — | — | 46.4 | 0.55 | |
| DP-LoRAModel=Base, Step Milestone=200, Task=QQP2025.10 | 70.2 | — | — | — | 70.2 | — | — | |
| DP-LoRAModel=Large, Step Milestone=200, Task=SST-22025.10 | 65.5 | 65.5 | — | — | — | — | — | |
| DP-LoRAModel=Large, Step Milestone=200, Task=MNLI2025.10 | 62.5 | — | 62.5 | — | — | — | — | |
| DP-LoRAModel=Base, Step Milestone=200, Task=QNLI2025.10 | 50.3 | — | — | 50.3 | — | — | — | |
| DP-LoRAModel=Base, Step Milestone=200, Task=MNLI2025.10 | 41.1 | — | 41.1 | — | — | — | — |