Paraphrase Detection on MRPC GLUE (val)
85.54AccuracySVD-Based Selection
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SVD-Based Selectionk (Protection Budget)=1, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 85.54 | — | — | |
| SVD-Based Selectionk (Protection Budget)=16, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 85.54 | — | — | |
| AWQk (Protection Budget)=64, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 85.29 | — | — | |
| SVD-Based Selectionk (Protection Budget)=64, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 85.29 | — | — | |
| AWQk (Protection Budget)=256, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 85.29 | — | — | |
| SVD-Based Selectionk (Protection Budget)=256, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 85.29 | — | — | |
| SVD-Based Selectionk (Protection Budget)=1024, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 85.29 | — | — | |
| AWQk (Protection Budget)=4096, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 85.29 | — | — | |
| SVD-Based Selectionk (Protection Budget)=4096, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 85.29 | — | — | |
| AWQk (Protection Budget)=1, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 85.05 | — | — | |
| AWQk (Protection Budget)=16, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 85.05 | — | — | |
| AWQk (Protection Budget)=1024, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 85.05 | — | — | |
| SpQRk (Protection Budget)=1, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 84.8 | — | — | |
| SpQRk (Protection Budget)=64, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 84.8 | — | — | |
| SpQRk (Protection Budget)=256, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 84.8 | — | — | |
| SpQRk (Protection Budget)=1024, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 84.8 | — | — | |
| SpQRk (Protection Budget)=4096, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 84.8 | — | — | |
| SpQRk (Protection Budget)=16, Backbone=distilbert-base-uncased, Quantization Precision=4-bit2025.12 | 84.56 | — | — | |
| BLoBBackbone=RoBERTa-base, N=102024.06 | 0.8873 | 0.033 | 0.26 | |
| ENSBackbone=RoBERTa-base2024.06 | 0.8864 | 0.1013 | 0.63 | |
| BLoBBackbone=RoBERTa-base, N=52024.06 | 0.8848 | 0.0449 | 0.27 | |
| BLoBBackbone=RoBERTa-base, N=02024.06 | 0.8824 | 0.0561 | 0.29 | |
| MCDBackbone=RoBERTa-base2024.06 | 0.8775 | 0.0736 | 0.39 | |
| LAPBackbone=RoBERTa-base2024.06 | 0.8652 | 0.0629 | 0.47 | |
| MAPBackbone=RoBERTa-base2024.06 | 0.8636 | 0.1112 | 0.58 | |
| MLEBackbone=RoBERTa-base2024.06 | 0.8627 | 0.1113 | 0.62 | |
| BBBBackbone=RoBERTa-base2024.06 | 0.6838 | 0.0646 | 0.63 |