Translation Attack on 17 supported languages LLaMA-3.2 1B
97.9AUCSTEAM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| STEAMType=Low-resource, Language=fa, Base Model=LLaMA-3.2 1B2025.10 | 97.9 | 66.4 | |
| STEAMType=High-resource, Language=it, Base Model=LLaMA-3.2 1B2025.10 | 97.7 | 62 | |
| STEAMType=Low-resource, Language=ta, Base Model=LLaMA-3.2 1B2025.10 | 97.7 | 46 | |
| STEAMType=High-resource, Language=de, Base Model=LLaMA-3.2 1B2025.10 | 97.5 | 53 | |
| STEAMType=Medium-resource, Language=pl, Base Model=LLaMA-3.2 1B2025.10 | 97.5 | 52.6 | |
| STEAMType=Low-resource, Language=vi, Base Model=LLaMA-3.2 1B2025.10 | 97.5 | 45.8 | |
| STEAMType=Medium-resource, Language=hi, Base Model=LLaMA-3.2 1B2025.10 | 97.4 | 59.8 | |
| STEAMType=Medium-resource, Language=nl, Base Model=LLaMA-3.2 1B2025.10 | 97.3 | 58 | |
| STEAMType=Medium-resource, Language=ja, Base Model=LLaMA-3.2 1B2025.10 | 97.3 | 48.2 | |
| STEAMType=Low-resource, Language=uk, Base Model=LLaMA-3.2 1B2025.10 | 97.3 | 48.2 | |
| STEAMType=Medium-resource, Language=ko, Base Model=LLaMA-3.2 1B2025.10 | 97.1 | 41.6 | |
| STEAMType=High-resource, Language=pt, Base Model=LLaMA-3.2 1B2025.10 | 97 | 47.6 | |
| STEAMType=Medium-resource, Language=ru, Base Model=LLaMA-3.2 1B2025.10 | 97 | 48.2 | |
| STEAMType=High-resource, Language=fr, Base Model=LLaMA-3.2 1B2025.10 | 96.9 | 61.8 | |
| STEAMType=High-resource, Language=es, Base Model=LLaMA-3.2 1B2025.10 | 96.9 | 52.2 | |
| STEAMType=Low-resource, Language=bn, Base Model=LLaMA-3.2 1B2025.10 | 96.7 | 49.6 | |
| STEAMType=Low-resource, Language=iw, Base Model=LLaMA-3.2 1B2025.10 | 96.6 | 50.2 | |
| KGWType=Low-resource, Language=ta, Base Model=LLaMA-3.2 1B2025.10 | 87.7 | 27.2 | |
| X-SIRType=Low-resource, Language=bn, Base Model=LLaMA-3.2 1B2025.10 | 82.5 | 50.9 | |
| X-KGWType=Medium-resource, Language=nl, Base Model=LLaMA-3.2 1B2025.10 | 78.7 | 25.2 | |
| X-KGWType=High-resource, Language=de, Base Model=LLaMA-3.2 1B2025.10 | 75.2 | 18.6 | |
| X-KGWType=High-resource, Language=it, Base Model=LLaMA-3.2 1B2025.10 | 75 | 23 | |
| X-SIRType=Low-resource, Language=ta, Base Model=LLaMA-3.2 1B2025.10 | 74.9 | 9.5 | |
| X-KGWType=High-resource, Language=pt, Base Model=LLaMA-3.2 1B2025.10 | 74.7 | 20.6 | |
| X-SIRType=High-resource, Language=pt, Base Model=LLaMA-3.2 1B2025.10 | 72.6 | 10.2 | |
| X-KGWType=Low-resource, Language=uk, Base Model=LLaMA-3.2 1B2025.10 | 72.5 | 11.8 | |
| X-KGWType=High-resource, Language=es, Base Model=LLaMA-3.2 1B2025.10 | 72.4 | 22.2 | |
| X-SIRType=Medium-resource, Language=nl, Base Model=LLaMA-3.2 1B2025.10 | 72.2 | 9.1 | |
| X-KGWType=Low-resource, Language=vi, Base Model=LLaMA-3.2 1B2025.10 | 72.2 | 18.6 | |
| X-KGWType=High-resource, Language=fr, Base Model=LLaMA-3.2 1B2025.10 | 71.9 | 16.6 | |
| KGWType=Medium-resource, Language=nl, Base Model=LLaMA-3.2 1B2025.10 | 71.9 | 12.6 | |
| X-SIRType=High-resource, Language=it, Base Model=LLaMA-3.2 1B2025.10 | 71.2 | 11.1 | |
| X-SIRType=High-resource, Language=de, Base Model=LLaMA-3.2 1B2025.10 | 70.8 | 6.7 | |
| X-SIRType=High-resource, Language=es, Base Model=LLaMA-3.2 1B2025.10 | 70.3 | 8.9 | |
| X-KGWType=Medium-resource, Language=pl, Base Model=LLaMA-3.2 1B2025.10 | 70.3 | 18.8 | |
| X-SIRType=High-resource, Language=fr, Base Model=LLaMA-3.2 1B2025.10 | 70.2 | 8.5 | |
| X-KGWType=Low-resource, Language=iw, Base Model=LLaMA-3.2 1B2025.10 | 70.2 | 13.4 | |
| X-KGWType=Medium-resource, Language=ko, Base Model=LLaMA-3.2 1B2025.10 | 70.1 | 15.4 | |
| X-KGWType=Low-resource, Language=bn, Base Model=LLaMA-3.2 1B2025.10 | 70.1 | 7.8 | |
| X-SIRType=Low-resource, Language=vi, Base Model=LLaMA-3.2 1B2025.10 | 69.1 | 8.4 | |
| X-SIRType=Medium-resource, Language=ko, Base Model=LLaMA-3.2 1B2025.10 | 67.3 | 5.5 | |
| X-KGWType=Low-resource, Language=fa, Base Model=LLaMA-3.2 1B2025.10 | 67.3 | 8.6 | |
| X-KGWType=Low-resource, Language=ta, Base Model=LLaMA-3.2 1B2025.10 | 67.2 | 10.8 | |
| KGWType=Low-resource, Language=vi, Base Model=LLaMA-3.2 1B2025.10 | 65.8 | 8.2 | |
| X-SIRType=Medium-resource, Language=pl, Base Model=LLaMA-3.2 1B2025.10 | 65.7 | 6.5 | |
| X-KGWType=Medium-resource, Language=ru, Base Model=LLaMA-3.2 1B2025.10 | 65.6 | 10 | |
| KGWType=High-resource, Language=fr, Base Model=LLaMA-3.2 1B2025.10 | 65.5 | 5.2 | |
| KGWType=High-resource, Language=pt, Base Model=LLaMA-3.2 1B2025.10 | 65.1 | 9.6 | |
| KGWType=High-resource, Language=de, Base Model=LLaMA-3.2 1B2025.10 | 64.9 | 9 | |
| X-SIRType=Medium-resource, Language=ru, Base Model=LLaMA-3.2 1B2025.10 | 63.5 | 7.5 | |
| KGWType=Medium-resource, Language=ru, Base Model=LLaMA-3.2 1B2025.10 | 62.9 | 5.2 | |
| KGWType=Low-resource, Language=uk, Base Model=LLaMA-3.2 1B2025.10 | 62.9 | 8.4 | |
| KGWType=Medium-resource, Language=ko, Base Model=LLaMA-3.2 1B2025.10 | 62.5 | 6.8 | |
| KGWType=Medium-resource, Language=pl, Base Model=LLaMA-3.2 1B2025.10 | 62.2 | 8.8 | |
| X-SIRType=Low-resource, Language=iw, Base Model=LLaMA-3.2 1B2025.10 | 62.2 | 2.6 | |
| X-KGWType=Medium-resource, Language=hi, Base Model=LLaMA-3.2 1B2025.10 | 62 | 8.4 | |
| KGWType=High-resource, Language=it, Base Model=LLaMA-3.2 1B2025.10 | 61.7 | 11.8 | |
| KGWType=High-resource, Language=es, Base Model=LLaMA-3.2 1B2025.10 | 61.6 | 12.2 | |
| X-SIRType=Low-resource, Language=uk, Base Model=LLaMA-3.2 1B2025.10 | 61.3 | 6.4 | |
| X-SIRType=Medium-resource, Language=hi, Base Model=LLaMA-3.2 1B2025.10 | 61.1 | 3.7 | |
| X-KGWType=Medium-resource, Language=ja, Base Model=LLaMA-3.2 1B2025.10 | 59.8 | 11 | |
| KGWType=Low-resource, Language=fa, Base Model=LLaMA-3.2 1B2025.10 | 58.6 | 8.2 | |
| X-SIRType=Low-resource, Language=fa, Base Model=LLaMA-3.2 1B2025.10 | 58.4 | 5.5 | |
| KGWType=Medium-resource, Language=ja, Base Model=LLaMA-3.2 1B2025.10 | 57.8 | 4.8 | |
| KGWType=Low-resource, Language=bn, Base Model=LLaMA-3.2 1B2025.10 | 57.4 | 2 | |
| X-SIRType=Medium-resource, Language=ja, Base Model=LLaMA-3.2 1B2025.10 | 57.1 | 4.2 | |
| KGWType=Medium-resource, Language=hi, Base Model=LLaMA-3.2 1B2025.10 | 56.8 | 4.8 | |
| KGWType=Low-resource, Language=iw, Base Model=LLaMA-3.2 1B2025.10 | 49.5 | 4.2 |