Multi-class Classification on Copa
92AccuracyI-GLASS
Evaluation Results
| Method | Links | |
|---|---|---|
| I-GLASSBackbone=Mistral 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.08 | 92 | |
| GRIFFINBackbone=Mistral 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.08 | 92 | |
| I-GLASSBackbone=Gemma 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.08 | 88 | |
| GRIFFINBackbone=Gemma 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.08 | 88 | |
| I-GLASSBackbone=ReLU-Llama2 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.08 | 88 | |
| GRIFFINBackbone=ReLU-Llama2 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.08 | 88 | |
| I-GLASSBackbone=Llama2 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.08 | 86 | |
| GRIFFINBackbone=Llama2 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.08 | 86 | |
| I-GLASSBackbone=OPT 6.7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.08 | 80 | |
| GRIFFINBackbone=OPT 6.7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.08 | 80 | |
| SimPLEModel Backbone=DeBERTa-large, Number of Parameters=350M, Number of runs=32023.05 | 79.75 | |
| SimPLEModel Backbone=RoBERTa-large, Number of Parameters=350M, Number of runs=32023.05 | 79 | |
| BaseSTModel Backbone=DeBERTa-large, Number of Parameters=350M, Number of runs=32023.05 | 78.75 | |
| DropoutModel Backbone=RoBERTa-large, Number of Parameters=350M, Number of runs=32023.05 | 78.67 | |
| DropoutModel Backbone=DeBERTa-large, Number of Parameters=350M, Number of runs=32023.05 | 78.25 | |
| SETREDModel Backbone=DeBERTa-large, Number of Parameters=350M, Number of runs=32023.05 | 78 | |
| SETREDModel Backbone=RoBERTa-large, Number of Parameters=350M, Number of runs=32023.05 | 78 | |
| PretrainModel Backbone=DeBERTa-large, Number of Parameters=350M, Number of runs=32023.05 | 77 | |
| T5-11bStrategy=Few-shot, Number of Parameters=11b2023.05 | 77 | |
| BaseSTModel Backbone=RoBERTa-large, Number of Parameters=350M, Number of runs=32023.05 | 76.67 | |
| PretrainModel Backbone=RoBERTa-large, Number of Parameters=350M, Number of runs=32023.05 | 76 | |
| T5-11bStrategy=Zero-shot, Number of Parameters=11b2023.05 | 70 |