Cross-lingual Alignment on EN-HI-CM (test)
86.95EN→CM Alignment ScoreHing-RoBERTa-Mixed
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Hing-RoBERTa-MixedRetrieval Method=Last Layer Retrieval, Model Family=XLM-R Family2026.03 | 86.95 | 92.37 | 83.2 | 84.98 | 72.88 | 77.78 | 73.09 | |
| Hing-RoBERTa-Mixed TrilingualRetrieval Method=Last Layer Retrieval, Model Family=XLM-R Family2026.03 | 86.4 | 93.31 | 84.65 | 84.08 | 73.27 | 80.96 | 73.5 | |
| Hing-RoBERTa TrilingualRetrieval Method=Last Layer Retrieval, Model Family=XLM-R Family2026.03 | 81.43 | 89.85 | 69.11 | 76.7 | 63.84 | 62.58 | 58.98 | |
| XLM-R TrilingualRetrieval Method=Mean Retrieval, Model Family=XLM-R Family2026.03 | 72.26 | 72.16 | 71.96 | 72.11 | 71.07 | 70.84 | 71.02 | |
| Hing-RoBERTa-MixedRetrieval Method=Mean Retrieval, Model Family=XLM-R Family2026.03 | 72.05 | 70.72 | 64.73 | 66.92 | 65.41 | 63.02 | 62.1 | |
| Hing-RoBERTa TrilingualRetrieval Method=Mean Retrieval, Model Family=XLM-R Family2026.03 | 71.62 | 73.85 | 67.55 | 69.61 | 64.36 | 64.21 | 63.6 | |
| Hing-RoBERTa-Mixed TrilingualRetrieval Method=Mean Retrieval, Model Family=XLM-R Family2026.03 | 70.41 | 68.01 | 65.57 | 65.87 | 65.68 | 62.9 | 62.51 | |
| mBERT TrilingualRetrieval Method=Last Layer Retrieval, Model Family=mBERT Family2026.03 | 69.43 | 63.49 | 71.52 | 73.23 | 54.49 | 49.69 | 50.97 | |
| Hing-RoBERTaRetrieval Method=Mean Retrieval, Model Family=XLM-R Family2026.03 | 69.4 | 68.93 | 54.33 | 56.81 | 55.75 | 52.45 | 50.75 | |
| XLM-RRetrieval Method=Mean Retrieval, Model Family=XLM-R Family2026.03 | 67.77 | 68.34 | 68.61 | 68.24 | 66.24 | 67.04 | 66.36 | |
| Hing-mBERT-Mixed TrilingualRetrieval Method=Mean Retrieval, Model Family=mBERT Family2026.03 | 66.78 | 67.82 | 56.11 | 60.56 | 58.01 | 55.44 | 53.45 | |
| Hing-mBERTRetrieval Method=Mean Retrieval, Model Family=mBERT Family2026.03 | 65.76 | 68.57 | 44.43 | 49.58 | 50.64 | 46.15 | 40.84 | |
| mBERT TrilingualRetrieval Method=Mean Retrieval, Model Family=mBERT Family2026.03 | 65.15 | 63.47 | 71.05 | 70.55 | 48.26 | 49.2 | 50.98 | |
| Hing-RoBERTaRetrieval Method=Last Layer Retrieval, Model Family=XLM-R Family2026.03 | 64.94 | 72.14 | 15.02 | 27.54 | 26.19 | 14.48 | 3.74 | |
| Hing-mBERT TrilingualRetrieval Method=Mean Retrieval, Model Family=mBERT Family2026.03 | 64.87 | 65.9 | 58.17 | 60.18 | 60.86 | 59.98 | 57.67 | |
| Hing-mBERT-MixedRetrieval Method=Mean Retrieval, Model Family=mBERT Family2026.03 | 60.57 | 62.31 | 48.89 | 50.63 | 56.25 | 55.72 | 49.62 | |
| mBERTRetrieval Method=Mean Retrieval, Model Family=mBERT Family2026.03 | 58.77 | 57.51 | 59.35 | 60.15 | 45.1 | 42.73 | 45.35 | |
| Hing-mBERT TrilingualRetrieval Method=Last Layer Retrieval, Model Family=mBERT Family2026.03 | 57.73 | 62.96 | 78.05 | 76.4 | 53 | 59.7 | 51.07 | |
| XLM-R TrilingualRetrieval Method=Last Layer Retrieval, Model Family=XLM-R Family2026.03 | 56.06 | 54.18 | 53.43 | 54.5 | 48.37 | 46.93 | 47.5 | |
| mBERTRetrieval Method=Last Layer Retrieval, Model Family=mBERT Family2026.03 | 54.75 | 42.9 | 74.87 | 33.8 | 26.3 | 39.05 | 14.2 | |
| Hing-mBERT-Mixed TrilingualRetrieval Method=Last Layer Retrieval, Model Family=mBERT Family2026.03 | 54.64 | 62.42 | 71.52 | 70.06 | 41.96 | 49.15 | 42.51 | |
| Hing-mBERT-MixedRetrieval Method=Last Layer Retrieval, Model Family=mBERT Family2026.03 | 54.26 | 74.63 | 41.81 | 60.73 | 49.51 | 48.94 | 34.95 | |
| Hing-mBERTRetrieval Method=Last Layer Retrieval, Model Family=mBERT Family2026.03 | 52.78 | 71.86 | 32.3 | 33.43 | 24.7 | 28.99 | 17.01 | |
| XLM-RRetrieval Method=Last Layer Retrieval, Model Family=XLM-R Family2026.03 | 50.56 | 50.67 | 58.81 | 54.33 | 38.37 | 40.46 | 39.53 |