List your company
ResearchFormerly WizWand

Cross-lingual Alignment Correlation on m-ARC FLORES (test)

0.9867Pearson CorrelationNAVCA
0.7643480.8220740.87980.937526Jul 20, 2025
Updated 8mo ago

Evaluation results

MethodLinks
NAVCABackbone=Mistral 0.3 7B, Aggregation Strategy=last2025.070.9867
NAVCABackbone=Mistral 0.3 7B, Aggregation Strategy=average2025.070.9847
NAVCABackbone=Qwen 2.5 7B, Aggregation Strategy=average2025.070.982
NAVCABackbone=Qwen 2.5 7B, Aggregation Strategy=last2025.070.9804
NAVCABackbone=Qwen 2.5 14B, Aggregation Strategy=average2025.070.9786
MEXABackbone=Qwen 2.5 14B, Aggregation Strategy=weighted2025.070.9773
NAVCABackbone=Llama 3.1 8B, Aggregation Strategy=average2025.070.9756
NAVCABackbone=Qwen 2.5 14B, Aggregation Strategy=last2025.070.9756
NAVCABackbone=Llama 3.1 8B, Aggregation Strategy=last2025.070.9751
NAVCABackbone=GLM 4 9B, Aggregation Strategy=average2025.070.9731
NAVCABackbone=Llama 3 8B, Aggregation Strategy=last2025.070.9728
NAVCABackbone=GLM 4 9B, Aggregation Strategy=last2025.070.9727
NAVCABackbone=Llama 3 8B, Aggregation Strategy=average2025.070.9725
NASCABackbone=GLM 4 9B, Aggregation Strategy=average2025.070.9713
NASCABackbone=GLM 4 9B, Aggregation Strategy=last2025.070.9705
NASCABackbone=Qwen 2.5 14B, Aggregation Strategy=average2025.070.9696
NASCABackbone=Qwen 2.5 14B, Aggregation Strategy=weighted2025.070.9692
NAVCABackbone=Qwen 2.5 7B, Aggregation Strategy=weighted2025.070.9692
MEXABackbone=GLM 4 9B, Aggregation Strategy=weighted2025.070.9688
NASCABackbone=Qwen 2.5 14B, Aggregation Strategy=last2025.070.9687
NAVCABackbone=Qwen 2.5 14B, Aggregation Strategy=weighted2025.070.9686
NAVCABackbone=Llama 2 7B, Aggregation Strategy=last2025.070.9682
NAVCABackbone=Llama 3.1 8B, Aggregation Strategy=weighted2025.070.9678
MEXABackbone=Qwen 2.5 7B, Aggregation Strategy=weighted2025.070.9664
MEXABackbone=Llama 3.1 8B, Aggregation Strategy=weighted2025.070.9657
NASCABackbone=Llama 3.1 8B, Aggregation Strategy=weighted2025.070.965
NAVCABackbone=Llama 2 7B, Aggregation Strategy=average2025.070.9649
NAVCABackbone=GLM 4 9B, Aggregation Strategy=weighted2025.070.9638
MEXABackbone=Llama 3 8B, Aggregation Strategy=weighted2025.070.9624
NAVCABackbone=OLMO 2 7B, Aggregation Strategy=last2025.070.9624
NAVCABackbone=Llama 3 8B, Aggregation Strategy=weighted2025.070.9616
NASCABackbone=GLM 4 9B, Aggregation Strategy=weighted2025.070.9592
NASCABackbone=Llama 3.1 8B, Aggregation Strategy=last2025.070.9591
MEXABackbone=Qwen 2.5 7B, Aggregation Strategy=average2025.070.9589
MEXABackbone=Mistral 0.3 7B, Aggregation Strategy=average2025.070.9575
NASCABackbone=Llama 3 8B, Aggregation Strategy=weighted2025.070.9575
NASCABackbone=Llama 3.1 8B, Aggregation Strategy=average2025.070.957
NAVCABackbone=OLMO 2 7B, Aggregation Strategy=average2025.070.9569
NASCABackbone=Mistral 0.3 7B, Aggregation Strategy=last2025.070.9565
MEXABackbone=Llama 3.1 8B, Aggregation Strategy=average2025.070.9551
NAVCABackbone=Llama 3.2 3B, Aggregation Strategy=last2025.070.9545
NAVCABackbone=Mistral 0.3 7B, Aggregation Strategy=weighted2025.070.954
NASCABackbone=Mistral 0.3 7B, Aggregation Strategy=average2025.070.9539
NASCABackbone=Llama 3 8B, Aggregation Strategy=last2025.070.9535
NASCABackbone=Llama 3 8B, Aggregation Strategy=average2025.070.9522
NAVCABackbone=Llama 3.2 3B, Aggregation Strategy=average2025.070.9522
NASCABackbone=Qwen 2.5 7B, Aggregation Strategy=last2025.070.951
NASCABackbone=Qwen 2.5 7B, Aggregation Strategy=average2025.070.9479
NASCABackbone=Mistral 0.3 7B, Aggregation Strategy=weighted2025.070.947
MEXABackbone=Llama 3 8B, Aggregation Strategy=average2025.070.9464
NASCABackbone=Qwen 2.5 7B, Aggregation Strategy=weighted2025.070.9438
MEXABackbone=Llama 2 7B, Aggregation Strategy=weighted2025.070.9426
NAVCABackbone=Llama 3.2 3B, Aggregation Strategy=weighted2025.070.9412
NASCABackbone=Llama 2 7B, Aggregation Strategy=last2025.070.94
NASCABackbone=Llama 2 7B, Aggregation Strategy=average2025.070.9369
MEXABackbone=Llama 3.2 3B, Aggregation Strategy=weighted2025.070.9319
MEXABackbone=Mistral 0.3 7B, Aggregation Strategy=weighted2025.070.931
NASCABackbone=Llama 3.2 3B, Aggregation Strategy=weighted2025.070.9308
MEXABackbone=Mistral 0.3 7B, Aggregation Strategy=last2025.070.9279
NASCABackbone=Llama 2 7B, Aggregation Strategy=weighted2025.070.9277
NASCABackbone=OLMO 2 7B, Aggregation Strategy=last2025.070.9261
NAVCABackbone=Llama 2 7B, Aggregation Strategy=weighted2025.070.9241
MEXABackbone=GLM 4 9B, Aggregation Strategy=average2025.070.9225
NASCABackbone=Llama 3.2 3B, Aggregation Strategy=last2025.070.9212
MEXABackbone=OLMO 2 7B, Aggregation Strategy=last2025.070.9187
NASCABackbone=Llama 3.2 3B, Aggregation Strategy=average2025.070.9186
NASCABackbone=OLMO 2 7B, Aggregation Strategy=average2025.070.9177
MEXABackbone=Llama 3.2 3B, Aggregation Strategy=average2025.070.9142
NAVCABackbone=OLMO 2 7B, Aggregation Strategy=weighted2025.070.9133
MEXABackbone=Llama 2 7B, Aggregation Strategy=average2025.070.9124
MEXABackbone=Llama 3 8B, Aggregation Strategy=last2025.070.8979
MEXABackbone=OLMO 2 7B, Aggregation Strategy=average2025.070.8925
MEXABackbone=Llama 3.2 3B, Aggregation Strategy=last2025.070.8925
NASCABackbone=OLMO 2 7B, Aggregation Strategy=weighted2025.070.8853
MEXABackbone=Llama 2 7B, Aggregation Strategy=last2025.070.8853
MEXABackbone=Llama 3.1 8B, Aggregation Strategy=last2025.070.8833
MEXABackbone=OLMO 2 7B, Aggregation Strategy=weighted2025.070.88
MEXABackbone=Qwen 2.5 14B, Aggregation Strategy=average2025.070.8709
MEXABackbone=GLM 4 9B, Aggregation Strategy=last2025.070.8543
MEXABackbone=Qwen 2.5 7B, Aggregation Strategy=last2025.070.7938
MEXABackbone=Qwen 2.5 14B, Aggregation Strategy=last2025.070.7729