Sequence Classification on GLUE & SuperGLUE Subsets (MultiRC, COPA, RTE, BoolQ, MRPC, CoLA)
86.11MultiRC AccuracyENS
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ENSBackbone=RoBERTa-large, Ensemble Size=x92026.04 | 86.11 | 0.23 | 86.4 | 1.17 | 81.16 | 1.06 | 86.31 | 0.08 | 88.04 | 0.32 | 83.54 | 0.75 | 85.26 | 0.6 | |
| ENSBackbone=RoBERTa-large, Ensemble Size=x72026.04 | 85.72 | 0.81 | 85.1 | 2.13 | 79.89 | 1.92 | 86.2 | 0.15 | 87.82 | 0.5 | 80.77 | 6.17 | 84.85 | 1.94 | |
| DSGDBackbone=RoBERTa-large, Ensemble Size=x92026.04 | 85.44 | 0.16 | 90.8 | 0.79 | 84.77 | 0.41 | 86.57 | 0.08 | 88.53 | 0.28 | 86.18 | 0.21 | 87.04 | 0.32 | |
| DSGDBackbone=RoBERTa-large2026.04 | 84.01 | 1.31 | 88.1 | 3.21 | 83.61 | 1.59 | 85.69 | 0.2 | 88.38 | 1.17 | 84.92 | 1.05 | 85.78 | 1.42 | |
| ENSBackbone=RoBERTa-large, Ensemble Size=x32026.04 | 82.77 | 8.99 | 82.9 | 4.72 | 79.86 | 3.01 | 85.86 | 0.35 | 86.74 | 1.4 | 78.24 | 7.86 | 82.82 | 4.35 | |
| ENSBackbone=RoBERTa-large, Ensemble Size=x52026.04 | 80.19 | 12.12 | 84.8 | 3.43 | 80.51 | 2.58 | 86.13 | 0.14 | 87.25 | 0.9 | 79.76 | 7.36 | 82.79 | 4.71 | |
| FFTBackbone=RoBERTa-large2026.04 | 74.05 | 14.5 | 74.7 | 15.71 | 76.17 | 15.44 | 83.2 | 7.39 | 84.9 | 5.33 | 78.95 | 8.46 | 78.66 | 11.13 | |
| FocalLossBackbone=RoBERTa-large2026.04 | 73.38 | 5.73 | 80.4 | 7.59 | 77.29 | 1.7 | 81.22 | 0.46 | 86.52 | 6.5 | 83.82 | 5.2 | 81.1 | 4.53 | |
| DSGDBackbone=Llama-3.2-1B, Ensemble Size=x92026.04 | 69.11 | 0.88 | 83.9 | 3.28 | 83.54 | 0.42 | 78.09 | 0.19 | 89.26 | 0.34 | 85.6 | 0.24 | 81.58 | 0.89 | |
| DSGDBackbone=Llama-3.2-1B2026.04 | 67.17 | 4.7 | 83.3 | 2.06 | 81.55 | 1.22 | 75.43 | 3.55 | 87.52 | 0.82 | 84.75 | 0.59 | 79.95 | 2.16 | |
| LNSRBackbone=RoBERTa-large2026.04 | 66.07 | 11.46 | 82 | 12.58 | 77.44 | 15.91 | 73.41 | 11.86 | 88.36 | 1.55 | 80.75 | 8.03 | 78 | 10.23 | |
| SWABackbone=RoBERTa-large2026.04 | 65.92 | 11.27 | 87.7 | 4.06 | 78.45 | 13.61 | 80.36 | 9.61 | 88.19 | 1.21 | 82.46 | 7.06 | 80.51 | 7.8 | |
| LNSRBackbone=Llama-3.2-1B2026.04 | 65.33 | 4.46 | 82.1 | 3.14 | 74.9 | 2.7 | 66.81 | 1.24 | 82.89 | 3.15 | 78.67 | 3.65 | 75.12 | 3.06 | |
| ENSBackbone=Llama-3.2-1B, Ensemble Size=x92026.04 | 64.2 | 0.16 | 83.7 | 3.56 | 82.96 | 0.28 | 76.64 | 0.55 | 88.26 | 0.69 | 85.3 | 0.23 | 80.18 | 0.91 | |
| ENSBackbone=Llama-3.2-1B, Ensemble Size=x52026.04 | 64.1 | 0.33 | 77.6 | 9.09 | 82.78 | 0.83 | 76.52 | 1.76 | 87.75 | 0.66 | 85.25 | 0.34 | 79 | 2.17 | |
| ENSBackbone=Llama-3.2-1B, Ensemble Size=x72026.04 | 63.79 | 0.32 | 81.3 | 7.18 | 83.14 | 0.3 | 76.57 | 0.72 | 88.48 | 0.54 | 85.11 | 0.33 | 79.73 | 1.56 | |
| NoisyTuneBackbone=RoBERTa-large2026.04 | 63.62 | 10.72 | 55 | 0 | 70.65 | 15.53 | 71.04 | 11.46 | 86.91 | 6.62 | 80.67 | 8.01 | 71.31 | 8.72 | |
| ENSBackbone=Llama-3.2-1B, Ensemble Size=x32026.04 | 63.44 | 0.42 | 81.1 | 4.79 | 81.91 | 1.06 | 76.12 | 2.9 | 87.65 | 0.83 | 84.94 | 0.76 | 79.2 | 1.79 | |
| SWABackbone=Llama-3.2-1B2026.04 | 62.53 | 1.01 | 55.5 | 5.51 | 76.17 | 1.47 | 67.29 | 1.64 | 82.62 | 3.79 | 79.95 | 2.02 | 70.67 | 2.57 | |
| FFTBackbone=Llama-3.2-1B2026.04 | 62.5 | 0.8 | 79.4 | 6.08 | 79.49 | 1.83 | 73.98 | 3.85 | 86.69 | 1.05 | 84.07 | 0.83 | 77.69 | 2.41 | |
| PCGradBackbone=RoBERTa-large2026.04 | 62.03 | 8.7 | 69.6 | 19.11 | 81.05 | 10.08 | 83.22 | 7.4 | 86.67 | 6.52 | 81.8 | 6.84 | 77.39 | 9.77 | |
| NoisyTuneBackbone=Llama-3.2-1B2026.04 | 60.85 | 0.93 | 55 | 0 | 74.69 | 2.92 | 67.64 | 1.01 | 84.76 | 2.08 | 80.91 | 0.44 | 70.64 | 1.23 | |
| PCGradBackbone=Llama-3.2-1B2026.04 | 60.76 | 3.24 | 76.4 | 2.95 | 73.83 | 2.95 | 67.77 | 1.21 | 82.84 | 3.39 | 80.09 | 1.62 | 73.61 | 2.56 | |
| FocalLossBackbone=Llama-3.2-1B2026.04 | 56.94 | 0.49 | 76 | 7.72 | 49.39 | 2.97 | 62.17 | 0 | 68.38 | 0 | 69.13 | 0 | 63.66 | 1.86 |