List your company
ResearchFormerly WizWand

Multi-class Classification on Copa

92AccuracyI-GLASS
69.1275.068186.94May 26, 2023Oct 9, 2023Feb 22, 2024Jul 7, 2024Nov 20, 2024Apr 5, 2025Aug 19, 2025
Updated 5mo ago

Evaluation results

MethodLinks
I-GLASSBackbone=Mistral 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0892
GRIFFINBackbone=Mistral 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0892
I-GLASSBackbone=Gemma 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0888
GRIFFINBackbone=Gemma 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0888
I-GLASSBackbone=ReLU-Llama2 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0888
GRIFFINBackbone=ReLU-Llama2 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0888
I-GLASSBackbone=Llama2 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0886
GRIFFINBackbone=Llama2 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0886
I-GLASSBackbone=OPT 6.7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0880
GRIFFINBackbone=OPT 6.7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0880
SimPLEModel Backbone=DeBERTa-large, Number of Parameters=350M, Number of runs=32023.0579.75
SimPLEModel Backbone=RoBERTa-large, Number of Parameters=350M, Number of runs=32023.0579
BaseSTModel Backbone=DeBERTa-large, Number of Parameters=350M, Number of runs=32023.0578.75
DropoutModel Backbone=RoBERTa-large, Number of Parameters=350M, Number of runs=32023.0578.67
DropoutModel Backbone=DeBERTa-large, Number of Parameters=350M, Number of runs=32023.0578.25
SETREDModel Backbone=DeBERTa-large, Number of Parameters=350M, Number of runs=32023.0578
SETREDModel Backbone=RoBERTa-large, Number of Parameters=350M, Number of runs=32023.0578
PretrainModel Backbone=DeBERTa-large, Number of Parameters=350M, Number of runs=32023.0577
T5-11bStrategy=Few-shot, Number of Parameters=11b2023.0577
BaseSTModel Backbone=RoBERTa-large, Number of Parameters=350M, Number of runs=32023.0576.67
PretrainModel Backbone=RoBERTa-large, Number of Parameters=350M, Number of runs=32023.0576
T5-11bStrategy=Zero-shot, Number of Parameters=11b2023.0570