Watermark Detection on Aya-23 8B 10 unsupported languages
0.974AUCSTEAM
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| STEAMLanguage=cs, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.974 | 55.4 | |
| STEAMLanguage=pt, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.971 | 46.6 | |
| STEAMLanguage=da, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.971 | 44.8 | |
| STEAMLanguage=ar, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.971 | 58.8 | |
| STEAMLanguage=es, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.967 | 54.8 | |
| STEAMLanguage=it, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.966 | 49.4 | |
| STEAMLanguage=nl, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.966 | 35.8 | |
| STEAMLanguage=hr, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.965 | 36.2 | |
| STEAMLanguage=ko, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.961 | 32.2 | |
| STEAMLanguage=pl, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.96 | 34.4 | |
| X-KGWLanguage=nl, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.808 | 31.4 | |
| X-KGWLanguage=es, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.807 | 23 | |
| X-SIRLanguage=it, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.796 | 17.7 | |
| X-KGWLanguage=pt, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.792 | 28.6 | |
| X-SIRLanguage=nl, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.776 | 16.4 | |
| X-SIRLanguage=pt, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.775 | 13.3 | |
| X-SIRLanguage=cs, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.773 | 11.1 | |
| X-KGWLanguage=it, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.772 | 23.8 | |
| KGWLanguage=nl, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.768 | 28.6 | |
| X-KGWLanguage=ar, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.765 | 16.8 | |
| X-KGWLanguage=da, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.764 | 26.6 | |
| X-KGWLanguage=pl, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.762 | 23.6 | |
| X-KGWLanguage=hr, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.757 | 21 | |
| X-SIRLanguage=es, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.754 | 15.5 | |
| X-KGWLanguage=cs, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.754 | 25.4 | |
| X-KGWLanguage=ko, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.754 | 22.6 | |
| X-SIRLanguage=pl, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.749 | 12.7 | |
| X-SIRLanguage=da, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.734 | 16.1 | |
| KGWLanguage=it, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.733 | 20.2 | |
| KGWLanguage=pt, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.732 | 24.2 | |
| KGWLanguage=ko, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.732 | 22 | |
| KGWLanguage=pl, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.73 | 24.8 | |
| X-SIRLanguage=ko, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.729 | 13.6 | |
| X-SIRLanguage=hr, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.726 | 12.4 | |
| KGWLanguage=es, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.717 | 23.2 | |
| KGWLanguage=cs, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.717 | 21.2 | |
| KGWLanguage=da, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.713 | 19.6 | |
| KGWLanguage=hr, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.706 | 19.4 | |
| KGWLanguage=ar, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.689 | 18.6 | |
| X-SIRLanguage=ar, Base Model=Aya-23 8B, Attack Type=Translation Attack2025.10 | 0.687 | 9.3 |