Paraphrase Detection on PAWS Wiki
86.8Accuracyall-mpnet-base-v2
Evaluation Results
| Method | Links | |
|---|---|---|
| all-mpnet-base-v2Evaluation Protocol=STS+DSD, STS Threshold=0.63, DSD Threshold=8·10-32026.03 | 86.8 | |
| all-MiniLM-L6-v2Evaluation Protocol=STS+DSD, STS Threshold=0.65, DSD Threshold=8·10-32026.03 | 80.8 | |
| all-mpnet-base-v2Evaluation Protocol=STS, STS Threshold=0.632026.03 | 79.5 | |
| all-MiniLM-L6-v2Evaluation Protocol=STS, STS Threshold=0.652026.03 | 72 | |
| EBT-GRCModel Type=Sequence Encoder2023.11 | 47.5 | |
| RIR-EBT-GRCModel Type=Sequence Encoder2023.11 | 46.8 | |
| BBT-GRCModel Type=Sequence Encoder2023.11 | 46.7 | |
| CRvNNModel Type=Sequence Encoder2023.11 | 46.6 | |
| BT-GRCModel Type=Sequence Encoder2023.11 | 46.4 | |
| BT-GRC OSModel Type=Sequence Encoder2023.11 | 46.3 | |
| OMModel Type=Sequence Encoder2023.11 | 45.6 | |
| RIR-GRCModel Type=Sequence Encoder2023.11 | 45.4 |