Paraphrase Identification on PAWS-X (de, en, ja, ko)
54.6Accuracy (de)TokAlign + LAT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| TokAlign + LATBackbone=Pythia-1B, Initialization=TokAlign, Language Adaptation Tuning (+LAT)=true, Zero-shot=true2025.06 | 54.6 | 50.2 | 55.9 | 54.9 | |
| ZeTT + LATBackbone=Pythia-1B, Initialization=ZeTT, Language Adaptation Tuning (+LAT)=true, Zero-shot=true2025.06 | 53 | 51 | 55.8 | 53.8 | |
| TokAlignBackbone=Pythia-1B, Initialization=TokAlign, Zero-shot=true2025.06 | 52.4 | 52.1 | 56.1 | 54.7 | |
| ZeTTBackbone=Pythia-1B, Initialization=ZeTT, Zero-shot=true2025.06 | 51.5 | 50.3 | 54.8 | 51.5 | |
| Focus + LATBackbone=Pythia-6.9B, Initialization=Focus, Language Adaptation Tuning (+LAT)=true, Zero-shot=true2025.06 | 51.1 | 43.8 | 55.9 | 55.3 | |
| Focus + LATBackbone=Pythia-1B, Initialization=Focus, Language Adaptation Tuning (+LAT)=true, Zero-shot=true2025.06 | 50.6 | 45.5 | 55.9 | 53.4 | |
| Pythia-1BInitialization=Vanilla, Zero-shot=true2025.06 | 49.6 | 49.3 | 54.8 | 54.9 | |
| TokAlignBackbone=Pythia-6.9B, Initialization=TokAlign, Zero-shot=true2025.06 | 48.8 | 44.6 | 56.2 | 55.7 | |
| FocusBackbone=Pythia-1B, Initialization=Focus, Zero-shot=true2025.06 | 44.8 | 44.9 | 45.7 | 44.8 | |
| FocusBackbone=Pythia-6.9B, Initialization=Focus, Zero-shot=true2025.06 | 44.8 | 42.4 | 52.7 | 45.5 | |
| Pythia-6.9BInitialization=Vanilla, Zero-shot=true2025.06 | 43.8 | 40.2 | 50.2 | 54.2 | |
| TokAlign + LATBackbone=Pythia-6.9B, Initialization=TokAlign, Language Adaptation Tuning (+LAT)=true, Zero-shot=true2025.06 | 43.2 | 45.8 | 55.8 | 55.8 |