Causal Reasoning on XCOPA (Multilingual Subset)
55.5Accuracy (zh)TokAlign + LAT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| TokAlign + LATBackbone=Pythia-6.9B, Initialization=TokAlign, Language Adaptation Tuning (+LAT)=true, Zero-shot=true2025.06 | 55.5 | 54.6 | 57 | 54.6 | |
| Focus + LATBackbone=Pythia-6.9B, Initialization=Focus, Language Adaptation Tuning (+LAT)=true, Zero-shot=true2025.06 | 55.4 | 54.2 | 52.4 | 53.8 | |
| Focus + LATBackbone=Pythia-1B, Initialization=Focus, Language Adaptation Tuning (+LAT)=true, Zero-shot=true2025.06 | 55.3 | 53.8 | 52.6 | 55.4 | |
| ZeTT + LATBackbone=Pythia-1B, Initialization=ZeTT, Language Adaptation Tuning (+LAT)=true, Zero-shot=true2025.06 | 55.3 | 55.8 | 50.8 | 54 | |
| TokAlignBackbone=Pythia-1B, Initialization=TokAlign, Zero-shot=true2025.06 | 55.3 | 53.6 | 48 | 55.2 | |
| TokAlign + LATBackbone=Pythia-1B, Initialization=TokAlign, Language Adaptation Tuning (+LAT)=true, Zero-shot=true2025.06 | 55.3 | 55.2 | 53.6 | 53.6 | |
| TokAlignBackbone=Pythia-6.9B, Initialization=TokAlign, Zero-shot=true2025.06 | 55.3 | 54.6 | 52.2 | 54.6 | |
| ZeTTBackbone=Pythia-1B, Initialization=ZeTT, Zero-shot=true2025.06 | 53.5 | 52.6 | 48.2 | 55.6 | |
| Pythia-1BInitialization=Vanilla, Zero-shot=true2025.06 | 52.9 | 54 | 53.2 | 55.4 | |
| FocusBackbone=Pythia-1B, Initialization=Focus, Zero-shot=true2025.06 | 52.4 | 48.6 | 57 | 45.9 | |
| FocusBackbone=Pythia-6.9B, Initialization=Focus, Zero-shot=true2025.06 | 52.2 | 48.6 | 55.6 | 44.5 | |
| Pythia-6.9BInitialization=Vanilla, Zero-shot=true2025.06 | 50.2 | 56.2 | 54.4 | 52.2 |