Recognizing Textual Entailment on RTE (GLUE val)
66.06AccuracySVD-Based Selection
Evaluation Results
| Method | Links | |
|---|---|---|
| SVD-Based SelectionProtection Budget (k)=4096, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 66.06 | |
| AWQProtection Budget (k)=4096, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 65.34 | |
| SpQRProtection Budget (k)=4096, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 65.34 | |
| AWQProtection Budget (k)=1, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 64.98 | |
| SpQRProtection Budget (k)=1, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 64.98 | |
| SVD-Based SelectionProtection Budget (k)=64, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 64.98 | |
| AWQProtection Budget (k)=1024, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 64.98 | |
| SVD-Based SelectionProtection Budget (k)=1024, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 64.98 | |
| SpQRProtection Budget (k)=16, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 64.26 | |
| AWQProtection Budget (k)=64, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 64.26 | |
| SpQRProtection Budget (k)=64, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 64.26 | |
| SpQRProtection Budget (k)=256, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 64.26 | |
| SVD-Based SelectionProtection Budget (k)=256, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 64.26 | |
| SpQRProtection Budget (k)=1024, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 64.26 | |
| AWQProtection Budget (k)=16, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 63.9 | |
| SVD-Based SelectionProtection Budget (k)=16, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 63.9 | |
| AWQProtection Budget (k)=256, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 63.9 | |
| SVD-Based SelectionProtection Budget (k)=1, Backbone=distilbert-base-uncased, Quantization=4-bit2025.12 | 63.54 |