Paraphrase Detection on MRPC (Accuracy)
76.2AccuracyFew-shot*
Evaluation Results
| Method | Links | |
|---|---|---|
| Few-shot*Backbone=Qwen2.5-7B, Few-shot settings=3-shot OOD2025.09 | 76.2 | |
| MIPICBackbone=TinyBERT 6L, Dim=5122026.04 | 74.67 | |
| MIPICBackbone=BERT, Dim=5122026.04 | 74.62 | |
| MIPICBackbone=TinyBERT 6L, Dim=7682026.04 | 74.6 | |
| MIPICBackbone=TinyBERT 6L, Dim=642026.04 | 74.55 | |
| MIPICBackbone=BERT, Dim=7682026.04 | 74.44 | |
| MIPICBackbone=TinyBERT 6L, Dim=2562026.04 | 74.37 | |
| ESEBackbone=TinyBERT 6L, Dim=5122026.04 | 74.31 | |
| MIPICBackbone=BERT, Dim=2562026.04 | 74.14 | |
| Unsup SimCSEBackbone=BERT, Dim=5122026.04 | 74.08 | |
| MIPICBackbone=TinyBERT 6L, Dim=322026.04 | 74.02 | |
| ESEBackbone=TinyBERT 6L, Dim=7682026.04 | 74.02 | |
| MIPICBackbone=BERT, Dim=1282026.04 | 74.02 | |
| Unsup SimCSEBackbone=BERT, Dim=7682026.04 | 74.02 | |
| MIPICBackbone=TinyBERT 6L, Dim=1282026.04 | 73.97 | |
| ESEBackbone=TinyBERT 6L, Dim=2562026.04 | 73.97 | |
| Unsup SimCSEBackbone=BERT, Dim=2562026.04 | 73.73 | |
| MIPICBackbone=BERT, Dim=642026.04 | 73.68 | |
| Unsup SimCSEBackbone=BERT, Dim=1282026.04 | 73.56 | |
| MIPICBackbone=BERT, Dim=322026.04 | 73.33 | |
| ESEBackbone=BERT, Dim=5122026.04 | 73.27 | |
| MRLBackbone=BERT, Dim=7682026.04 | 73.22 | |
| ICRBackbone=Qwen2.5-7B2025.09 | 73.2 | |
| MRLBackbone=BERT, Dim=5122026.04 | 73.16 | |
| MRLBackbone=BERT, Dim=2562026.04 | 72.98 | |
| MRLBackbone=BERT, Dim=1282026.04 | 72.96 | |
| ESEBackbone=TinyBERT 6L, Dim=1282026.04 | 72.89 | |
| MRLBackbone=TinyBERT 6L, Dim=7682026.04 | 72.87 | |
| MRLBackbone=TinyBERT 6L, Dim=5122026.04 | 72.76 | |
| ESEBackbone=BERT, Dim=642026.04 | 72.57 | |
| MRLBackbone=TinyBERT 6L, Dim=2562026.04 | 72.52 | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dim=7682026.04 | 72.51 | |
| MIPICBackbone=BERT, Dim=162026.04 | 72.46 | |
| ESEBackbone=BERT, Dim=7682026.04 | 72.46 | |
| Zero-shotBackbone=Qwen2.5-7B2025.09 | 72.4 | |
| MIPICBackbone=TinyBERT 6L, Dim=162026.04 | 72.34 | |
| MRLBackbone=TinyBERT 6L, Dim=1282026.04 | 72.34 | |
| ESEBackbone=BERT, Dim=2562026.04 | 72.29 | |
| MRLBackbone=TinyBERT 6L, Dim=642026.04 | 72.28 | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dim=5122026.04 | 72.16 | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dim=2562026.04 | 71.82 | |
| ESEBackbone=BERT, Dim=1282026.04 | 71.71 | |
| ESEBackbone=BERT, Dim=322026.04 | 71.07 | |
| M²IVBackbone=Qwen2.5-7B2025.09 | 71 | |
| I2CLBackbone=Qwen2.5-7B2025.09 | 70.8 | |
| Unsup SimCSEBackbone=BERT, Dim=642026.04 | 70.53 | |
| MRLBackbone=BERT, Dim=642026.04 | 70.14 | |
| ESEBackbone=TinyBERT 6L, Dim=642026.04 | 70.12 | |
| MRLBackbone=BERT, Dim=322026.04 | 70.11 | |
| MRLBackbone=TinyBERT 6L, Dim=322026.04 | 69.87 | |
| LIVEBackbone=Qwen2.5-7B2025.09 | 69.4 | |
| ESEBackbone=TinyBERT 6L, Dim=322026.04 | 69.38 | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dim=642026.04 | 68.25 | |
| Few-shot*Backbone=Llama2-7B, Few-shot settings=3-shot OOD2025.09 | 68.2 | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dim=1282026.04 | 68.15 | |
| ESEBackbone=BERT, Dim=162026.04 | 66.73 | |
| Unsup SimCSEBackbone=BERT, Dim=322026.04 | 66.72 | |
| MRLBackbone=BERT, Dim=162026.04 | 65.93 | |
| ESEBackbone=TinyBERT 6L, Dim=162026.04 | 65.12 | |
| MRLBackbone=TinyBERT 6L, Dim=162026.04 | 61.12 | |
| Unsup SimCSEBackbone=BERT, Dim=162026.04 | 57.83 | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dim=322026.04 | 57.34 | |
| ICRBackbone=Llama2-7B2025.09 | 53.4 | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dim=162026.04 | 51.32 | |
| LIVEBackbone=Llama2-7B2025.09 | 47.6 | |
| M²IVBackbone=Llama2-7B2025.09 | 46 | |
| Zero-shotBackbone=Llama2-7B2025.09 | 44.4 | |
| I2CLBackbone=Llama2-7B2025.09 | 42.4 |