Text Classification on AG-News (Accuracy and Delta Metrics)
-0.261Delta AccuracyActivation Range Masking
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Activation Range MaskingModel=BERT, Neurons Selected Percentage=50%2025.02 | -0.261 | — | — | — | — | -0.59 | 0.013 | -0.009 | |
| Neuron MaskingModel=BERT, Neurons Selected Percentage=50%2025.02 | -0.271 | — | — | — | — | -0.59 | 0.012 | -0.074 | |
| Activation Range MaskingModel=GPT-2, Neurons Selected Percentage=50%2025.02 | -0.849 | — | — | — | — | -0.862 | -0.063 | -0.223 | |
| Neuron MaskingModel=GPT-2, Neurons Selected Percentage=50%2025.02 | -0.871 | — | — | — | — | -0.877 | -0.155 | -0.163 | |
| Neuron MaskingModel=Llama, Neurons Selected Percentage=30%2025.02 | -0.934 | — | — | — | — | -0.725 | -0.66 | -0.572 | |
| Activation Range MaskingModel=Llama, Neurons Selected Percentage=30%2025.02 | -0.935 | — | — | — | — | -0.725 | -0.484 | -0.454 | |
| Base ModelModel=BERT2025.02 | — | 94.8 | 92.9 | 94.8 | 92.9 | — | — | — | |
| Base ModelModel=GPT-22025.02 | — | 94.5 | 93.3 | 94.5 | 93.3 | — | — | — | |
| Base ModelModel=Llama2025.02 | — | 100 | 74.4 | 100 | 74.4 | — | — | — |