Paraphrase Identification on PAWS-X (test)
91.4AccuracyFILTER
Evaluation Results
| Method | Links | |
|---|---|---|
| FILTERProtocol=Translate-train, Learning approach=Self-Teaching2020.09 | 91.4 | |
| FILTERProtocol=Translate-train2020.09 | 91.2 | |
| XLM-RProtocol=Translate-train, Learning approach=multi-task2020.09 | 90.4 | |
| mBERTProtocol=Translate-train, Learning approach=multi-task2020.09 | 88.9 | |
| X-STILTSProtocol=Cross-lingual zero-shot transfer2020.09 | 87.9 | |
| XLM-RProtocol=Cross-lingual zero-shot transfer2020.09 | 86.4 | |
| mBERTProtocol=Translate-train2020.09 | 86.3 | |
| mBERTProtocol=Cross-lingual zero-shot transfer2020.09 | 81.9 | |
| XLMProtocol=Cross-lingual zero-shot transfer2020.09 | 80.9 | |
| KOMBO_JamoTokenization=Jamo, Vocab Size=1702026.04 | 70.88 | |
| BERTTokenization=Subword, Vocab Size=32K2026.04 | 68.88 | |
| BERTTokenization=Character, Vocab Size=2K2026.04 | 68.7 | |
| BERTTokenization=MorSubword, Vocab Size=32K2026.04 | 68.14 | |
| BERTTokenization=Morpheme, Vocab Size=32K2026.04 | 66.66 | |
| KOMBO_CjiTokenization=Cji, Vocab Size=1362026.04 | 66.11 | |
| KOMBO_StrokeTokenization=Stroke, Vocab Size=1302026.04 | 63.79 | |
| KOMBO_BTSTokenization=BTS, Vocab Size=1122026.04 | 62.49 | |
| BERTTokenization=Word, Vocab Size=64K2026.04 | 61.16 | |
| BERTTokenization=Jamo, Vocab Size=1702026.04 | 59.09 | |
| BERTTokenization=BTS, Vocab Size=1122026.04 | 55.33 | |
| BERTTokenization=Stroke, Vocab Size=1302026.04 | 54.67 | |
| BERTTokenization=Cji, Vocab Size=1362026.04 | 54.67 |