Cross-lingual Alignment on Bible
0.3568Mean MEXA ScoreMEXA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MEXAModel=Gemma 2, Parameters=9B, Embedding pooling strategy=Mean2024.10 | 0.3568 | — | |
| MEXAModel=Llama 3.1, Parameters=70B, Embedding pooling strategy=Mean2024.10 | 0.3169 | — | |
| MEXAModel=Gemma 1, Parameters=7B, Embedding pooling strategy=Mean2024.10 | 0.2152 | — | |
| MEXAModel=Llama 3.1, Parameters=8B, Embedding pooling strategy=Mean2024.10 | 0.2103 | — | |
| MEXAModel=Llama 3, Parameters=8B, Embedding pooling strategy=Mean2024.10 | 0.2026 | — | |
| MEXAModel=Llama 2, Parameters=7B, Embedding pooling strategy=Mean2024.10 | 0.1246 | — | |
| MEXAModel=Mistral 0.3, Parameters=7B, Embedding pooling strategy=Mean2024.10 | 0.1198 | — | |
| MEXAModel=Llama 1, Parameters=7B, Embedding pooling strategy=Mean2024.10 | 0.0908 | — | |
| MEXAModel=OLMO 1.7, Parameters=7B, Embedding pooling strategy=Mean2024.10 | 0.0121 | — | |
| MEXAModel=Gemma 2, Parameters=9B, Embedding pooling strategy=Max2024.10 | — | 0.6076 | |
| MEXAModel=Gemma 1, Parameters=7B, Embedding pooling strategy=Max2024.10 | — | 0.4021 | |
| MEXAModel=Llama 3.1, Parameters=70B, Embedding pooling strategy=Max2024.10 | — | 0.6599 | |
| MEXAModel=Llama 3.1, Parameters=8B, Embedding pooling strategy=Max2024.10 | — | 0.4212 | |
| MEXAModel=Llama 3, Parameters=8B, Embedding pooling strategy=Max2024.10 | — | 0.419 | |
| MEXAModel=Llama 2, Parameters=7B, Embedding pooling strategy=Max2024.10 | — | 0.2724 | |
| MEXAModel=Llama 1, Parameters=7B, Embedding pooling strategy=Max2024.10 | — | 0.2357 | |
| MEXAModel=Mistral 0.3, Parameters=7B, Embedding pooling strategy=Max2024.10 | — | 0.2606 | |
| MEXAModel=OLMO 1.7, Parameters=7B, Embedding pooling strategy=Max2024.10 | — | 0.0319 |