List your company
ResearchFormerly WizWand

Recognizing Textual Entailment on RTE (GLUE val)

66.06AccuracySVD-Based Selection
63.439264.119664.865.4804Dec 1, 2025
Updated 8mo ago

Evaluation results

MethodLinks
SVD-Based SelectionProtection Budget (k)=4096, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1266.06
AWQProtection Budget (k)=4096, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1265.34
SpQRProtection Budget (k)=4096, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1265.34
AWQProtection Budget (k)=1, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1264.98
SpQRProtection Budget (k)=1, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1264.98
SVD-Based SelectionProtection Budget (k)=64, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1264.98
AWQProtection Budget (k)=1024, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1264.98
SVD-Based SelectionProtection Budget (k)=1024, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1264.98
SpQRProtection Budget (k)=16, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1264.26
AWQProtection Budget (k)=64, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1264.26
SpQRProtection Budget (k)=64, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1264.26
SpQRProtection Budget (k)=256, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1264.26
SVD-Based SelectionProtection Budget (k)=256, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1264.26
SpQRProtection Budget (k)=1024, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1264.26
AWQProtection Budget (k)=16, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1263.9
SVD-Based SelectionProtection Budget (k)=16, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1263.9
AWQProtection Budget (k)=256, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1263.9
SVD-Based SelectionProtection Budget (k)=1, Backbone=distilbert-base-uncased, Quantization=4-bit2025.1263.54