Text Classification on SST-5 (test)
56.21AccuracyPRL
Evaluation Results
| Method | Links | |
|---|---|---|
| PRL2025.12 | 56.21 | |
| BCN with SuBiLSTM-Tied+CoVeArchitecture=BCN, Encoder=SuBiLSTM-Tied, Embeddings=CoVe2018.05 | 56.2 | |
| PLR-4Model=Llama3.1-8B-Instruct, k=322026.03 | 55.96 | |
| DE2025.12 | 55.25 | |
| T-few 3Bsamples per class=82022.10 | 55 | |
| StaticModel=Qwen2.5-7B-Instruct, k=42026.03 | 54.78 | |
| BCN with SuBiLSTM+CoVeArchitecture=BCN, Encoder=SuBiLSTM, Embeddings=CoVe2018.05 | 54.5 | |
| BCN with 2-layer BiLSTM+CoVeArchitecture=BCN, Encoder=2-layer BiLSTM, Embeddings=CoVe2018.05 | 54 | |
| APO2025.12 | 53.94 | |
| GA2025.12 | 53.76 | |
| BCN+Char+CoVeArchitecture=BCN, Embeddings=Char, CoVe2018.05 | 53.7 | |
| BCN with BiLSTM+CoVeArchitecture=BCN, Encoder=BiLSTM, Embeddings=CoVe2018.05 | 53.6 | |
| BCN with 2-layer BiLSTMArchitecture=BCN, Encoder=2-layer BiLSTM2018.05 | 53.5 | |
| BCN with SuBiLSTM-TiedArchitecture=BCN, Encoder=SuBiLSTM-Tied2018.05 | 53.4 | |
| PIAST (E)variant=Ensemble2025.12 | 53.33 | |
| PIAST2025.12 | 53.27 | |
| BCN with BiLSTMArchitecture=BCN, Encoder=BiLSTM2018.05 | 53.2 | |
| BCN with SuBiLSTMArchitecture=BCN, Encoder=SuBiLSTM2018.05 | 53.2 | |
| PIAST (LOO)variant=Leave-one-out2025.12 | 53.18 | |
| NTIArchitecture=NTI2018.05 | 53.1 | |
| TE-LSTMArchitecture=TE-LSTM2018.05 | 52.6 | |
| MI2025.12 | 52.31 | |
| NI2025.12 | 51.9 | |
| Fine-tuned BERTSNN=false, Spike=false, PE=false, Param (M)=109.82024.05 | 50.41 | |
| PIAST (I)variant=Iterative2025.12 | 49.79 | |
| APE2025.12 | 49.37 | |
| Ensemble of SetFit + OCDsamples per class=82022.10 | 48.6 | |
| Mean of 5 OCD instancessamples per class=82022.10 | 47.9 | |
| SetFit + OCDsamples per class=82022.10 | 47.8 | |
| Our method (Weight Net)Imbalance Factor=500:752022.08 | 44.95 | |
| Our method (Weight Net)Imbalance Factor=500:602022.08 | 44.79 | |
| Our method (Weight Net)Imbalance Factor=500:502022.08 | 44.68 | |
| Constraint-based re-weightingImbalance Factor=500:502022.08 | 44.62 | |
| Fine-Tuned BERT+CEImbalance Factor=500:602022.08 | 44.06 | |
| Fine-Tuned BERTImbalance Factor=500:752022.08 | 43.76 | |
| Fine-Tuned BERT+CEImbalance Factor=500:752022.08 | 43.71 | |
| Spikformer w/ CPG-PESNN=true, Spike=true, PE=true, Param (M)=110.42024.05 | 43.62 | |
| SetFitsamples per class=82022.10 | 43.6 | |
| Logit AdjustmentImbalance Factor=500:752022.08 | 43.52 | |
| Fine-Tuned BERTImbalance Factor=500:602022.08 | 43.25 | |
| LDAM-DRWImbalance Factor=500:752022.08 | 43.2 | |
| ProportionImbalance Factor=500:752022.08 | 42.78 | |
| Probabilistic Transformer2023.11 | 42.77 | |
| Fine-Tuned BERTImbalance Factor=500:502022.08 | 42.7 | |
| Spikformer w/ Float-PESNN=true, Spike=false, PE=true, Param (M)=109.82024.05 | 42.58 | |
| ProportionImbalance Factor=500:602022.08 | 42.36 | |
| Spikformer w/ Random-PESNN=true, Spike=true, PE=true, Param (M)=110.42024.05 | 41.86 | |
| Spikformer w/o PESNN=true, Spike=false, PE=false, Param (M)=109.82024.05 | 41.84 | |
| ProportionImbalance Factor=500:502022.08 | 41.6 | |
| LDAM-DRWImbalance Factor=500:602022.08 | 40.9 | |
| LDAM-DRWImbalance Factor=500:502022.08 | 40.81 | |
| Hu et al.'s+RegularizationImbalance Factor=500:502022.08 | 40.14 | |
| Transformer2023.11 | 40.13 | |
| Hu et al.'sImbalance Factor=500:502022.08 | 39.82 | |
| Logit AdjustmentImbalance Factor=500:602022.08 | 39.52 | |
| Vanilla BERTImbalance Factor=500:752022.08 | 36.99 | |
| Vanilla BERTImbalance Factor=500:602022.08 | 36.75 | |
| Logit AdjustmentImbalance Factor=500:502022.08 | 36.55 | |
| Vanilla BERTImbalance Factor=500:502022.08 | 36.46 | |
| Fine-Tuned BERT+CEImbalance Factor=500:502022.08 | 36.46 |