Paraphrase Detection on MRPC (Accuracy and F1)
90.43AccuracyVanilla
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Vanilla2024.09 | 90.43 | — | |
| CrossWeigh2024.09 | 90.35 | — | |
| SubRegWeighVariant=Random2024.09 | 90.16 | — | |
| SubRegWeighVariant=Cos-Sim2024.09 | 89.69 | — | |
| LoRAModel=DeBERTa v2 XXL [24], Adapter Rank=162026.06 | 88.28 | — | |
| cLAModel=RoBERTa-Large [42], Adapter Rank=162026.06 | 87.81 | — | |
| FFTModel=RoBERTa-Base [42], Adapter Rank=162026.06 | 87.4 | — | |
| SubRegWeighVariant=K-means2024.09 | 86.82 | — | |
| cLAModel=DeBERTa v2 XXL [24], Adapter Rank=162026.06 | 86.13 | — | |
| r-c3LAModel=DeBERTa v3 Base [23], Adapter Rank=162026.06 | 84.17 | — | |
| Se²2024.02 | 77.9 | 85.6 | |
| UPRISE2024.02 | 76 | 84.2 | |
| KiteBackbone=Qwen 2.5–1.5B2025.09 | 75.27 | — | |
| CEILBackbone=Qwen 2.5–1.5B2025.09 | 74.25 | — | |
| MICBackbone=BERT, Dimension=7682026.05 | 73.96 | — | |
| DenseBackbone=Qwen 2.5–1.5B2025.09 | 73.92 | — | |
| MICBackbone=TinyBERT 6L, Dimension=7682026.05 | 73.91 | — | |
| Unsup SimCSEBackbone=BERT, Dimension=7682026.05 | 73.91 | — | |
| MICBackbone=BERT, Dimension=5122026.05 | 73.82 | — | |
| Unsup SimCSEBackbone=BERT, Dimension=5122026.05 | 73.79 | — | |
| BM25Backbone=Qwen 2.5–1.5B2025.09 | 73.77 | — | |
| MICBackbone=TinyBERT 6L, Dimension=5122026.05 | 73.74 | — | |
| MICBackbone=BERT, Dimension=1282026.05 | 73.73 | — | |
| MICBackbone=TinyBERT 6L, Dimension=2562026.05 | 73.69 | — | |
| MICBackbone=BERT, Dimension=322026.05 | 73.56 | — | |
| MICBackbone=TinyBERT 6L, Dimension=1282026.05 | 73.45 | — | |
| MICBackbone=BERT, Dimension=2562026.05 | 73.41 | — | |
| MICBackbone=BERT, Dimension=642026.05 | 73.39 | — | |
| MICBackbone=TinyBERT 6L, Dimension=642026.05 | 73.33 | — | |
| MICBackbone=TinyBERT 6L, Dimension=322026.05 | 73.27 | — | |
| ESEBackbone=BERT, Dimension=5122026.05 | 73.27 | — | |
| MRLBackbone=BERT, Dimension=7682026.05 | 73.22 | — | |
| MRLBackbone=BERT, Dimension=5122026.05 | 73.16 | — | |
| Unsup SimCSEBackbone=BERT, Dimension=1282026.05 | 73.14 | — | |
| Unsup SimCSEBackbone=BERT, Dimension=2562026.05 | 73.07 | — | |
| MICBackbone=BERT, Dimension=162026.05 | 73.04 | — | |
| ESEBackbone=TinyBERT 6L, Dimension=642026.05 | 72.98 | — | |
| MRLBackbone=BERT, Dimension=2562026.05 | 72.98 | — | |
| MRLBackbone=BERT, Dimension=1282026.05 | 72.96 | — | |
| MRLBackbone=TinyBERT 6L, Dimension=7682026.05 | 72.85 | — | |
| MICBackbone=TinyBERT 6L, Dimension=162026.05 | 72.7 | — | |
| ESEBackbone=TinyBERT 6L, Dimension=2562026.05 | 72.63 | — | |
| MRLBackbone=TinyBERT 6L, Dimension=5122026.05 | 72.6 | — | |
| ESEBackbone=BERT, Dimension=642026.05 | 72.57 | — | |
| ESEBackbone=TinyBERT 6L, Dimension=1282026.05 | 72.52 | — | |
| ESEBackbone=BERT, Dimension=7682026.05 | 72.46 | — | |
| MRLBackbone=TinyBERT 6L, Dimension=2562026.05 | 72.31 | — | |
| ESEBackbone=BERT, Dimension=2562026.05 | 72.29 | — | |
| ESEBackbone=TinyBERT 6L, Dimension=322026.05 | 72.28 | — | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dimension=7682026.05 | 72.18 | — | |
| MRLBackbone=TinyBERT 6L, Dimension=1282026.05 | 72.07 | — | |
| ESEBackbone=TinyBERT 6L, Dimension=7682026.05 | 72.01 | — | |
| ESEBackbone=TinyBERT 6L, Dimension=5122026.05 | 72 | — | |
| KiteBackbone=Llama 3.2–3B2025.09 | 71.98 | — | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dimension=5122026.05 | 71.97 | — | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dimension=2562026.05 | 71.82 | — | |
| DenseBackbone=Llama 3.2–3B2025.09 | 71.81 | — | |
| ESEBackbone=TinyBERT 6L, Dimension=162026.05 | 71.71 | — | |
| ESEBackbone=BERT, Dimension=1282026.05 | 71.71 | — | |
| MRLBackbone=TinyBERT 6L, Dimension=642026.05 | 71.44 | — | |
| RandomBackbone=Llama 3.2–3B2025.09 | 71.12 | — | |
| ESEBackbone=BERT, Dimension=322026.05 | 71.07 | — | |
| CEILBackbone=Llama 3.2–3B2025.09 | 70.63 | — | |
| BM25Backbone=Llama 3.2–3B2025.09 | 70.58 | — | |
| Unsup SimCSEBackbone=BERT, Dimension=642026.05 | 70.53 | — | |
| RandomBackbone=Qwen 2.5–1.5B2025.09 | 70.45 | — | |
| MRLBackbone=BERT, Dimension=642026.05 | 70.14 | — | |
| MRLBackbone=BERT, Dimension=322026.05 | 70.11 | — | |
| MRLBackbone=TinyBERT 6L, Dimension=322026.05 | 69.87 | — | |
| Best-of-102024.02 | 69.4 | 81.3 | |
| KiteBackbone=GPT-Neo 2.7B2025.09 | 68.38 | — | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dimension=642026.05 | 68.25 | — | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dimension=1282026.05 | 68.15 | — | |
| CEILBackbone=GPT-Neo 2.7B2025.09 | 68.04 | — | |
| BM25Backbone=GPT-Neo 2.7B2025.09 | 66.96 | — | |
| ESEBackbone=BERT, Dimension=162026.05 | 66.73 | — | |
| Unsup SimCSEBackbone=BERT, Dimension=322026.05 | 66.72 | — | |
| RandomBackbone=GPT-Neo 2.7B2025.09 | 66.38 | — | |
| MRLBackbone=BERT, Dimension=162026.05 | 65.93 | — | |
| DenseBackbone=GPT-Neo 2.7B2025.09 | 65.83 | — | |
| AES2024.02 | 64.2 | — | |
| Random2024.02 | 61.4 | 73.1 | |
| MRLBackbone=TinyBERT 6L, Dimension=162026.05 | 61.12 | — | |
| BM252024.02 | 58.8 | 70.2 | |
| SBERT2024.02 | 58.8 | 70.1 | |
| Instructor2024.02 | 58.8 | 70 | |
| Unsup SimCSEBackbone=BERT, Dimension=162026.05 | 57.83 | — | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dimension=322026.05 | 57.34 | — | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dimension=162026.05 | 51.32 | — | |
| Zero-shot2024.02 | 46.6 | 46 | |
| FoTBackbone=RoBERTa_LARGE, Samples per class=16, Pre-trained prompt=false2025.06 | — | 61.56 | |
| FoTBackbone=RoBERTa_LARGE, Samples per class=16, Pre-trained prompt=true2025.06 | — | 75.51 | |
| Prompt TuningBackbone=RoBERTa_LARGE, Samples per class=16, Pre-trained prompt=false2025.06 | — | 51.61 | |
| Prompt TuningBackbone=RoBERTa_LARGE, Samples per class=16, Pre-trained prompt=true2025.06 | — | 77.48 | |
| SecP-TuningBackbone=RoBERTa_LARGE, Samples per class=162025.06 | — | 75.33 | |
| SFTBackbone=RoBERTa_LARGE, Samples per class=162025.06 | — | 77.35 |