Question Answering on TyDiQA
52.14Exact MatchFLARE
Evaluation results
| Method | Links | |
|---|---|---|
| FLARETransfer Strategy=Translate-Train, Base Model=Gemma 2 9B2025.01 | 52.14 | |
| input-level fusionTransfer Strategy=Translate-Train, Base Model=Gemma 2 9B2025.01 | 51.29 | |
| LoRATransfer Strategy=Translate-Train, Base Model=Gemma 2 9B2025.01 | 49.93 | |
| FLARE MTTransfer Strategy=Translate-Train, Base Model=Gemma 2 9B2025.01 | 49.63 | |
| FLARETransfer Strategy=Translate-Train, Base Model=mT5-XL2025.01 | 49.34 | |
| FLARE MTTransfer Strategy=Translate-Train, Base Model=mT5-XL2025.01 | 48.48 | |
| X-MixupTransfer Strategy=Translate-Train, Base Model=mT5-XL2025.01 | 48.23 | |
| mT5-XLTransfer Strategy=Translate-Test2025.01 | 47.92 | |
| FLARETransfer Strategy=Translate-Train, Base Model=Llama 3.1 8B2025.01 | 47.74 | |
| input-level fusionTransfer Strategy=Translate-Train, Base Model=mT5-XL2025.01 | 47.58 | |
| LoRATransfer Strategy=Translate-Train, Base Model=mT5-XL2025.01 | 46.76 | |
| input-level fusionTransfer Strategy=Translate-Train, Base Model=Llama 3.1 8B2025.01 | 46.09 | |
| mT5-XLTransfer Strategy=Zero-Shot Cross-Lingual Transfer2025.01 | 45.9 | |
| LoRATransfer Strategy=Translate-Train, Base Model=Llama 3.1 8B2025.01 | 42.84 | |
| XLM-R LargeTransfer Strategy=Translate-Test2025.01 | 41.06 | |
| FLARETransfer Strategy=Translate-Train, Base Model=XLM-R Large2025.01 | 40.93 | |
| input-level fusionTransfer Strategy=Translate-Train, Base Model=XLM-R Large2025.01 | 40.45 | |
| LoRATransfer Strategy=Translate-Train, Base Model=XLM-R Large2025.01 | 40.14 | |
| FLARE MTTransfer Strategy=Translate-Train, Base Model=Llama 3.1 8B2025.01 | 38.95 | |
| FLARE MTTransfer Strategy=Translate-Train, Base Model=XLM-R Large2025.01 | 38.88 | |
| X-MixupTransfer Strategy=Translate-Train, Base Model=XLM-R Large2025.01 | 38.24 | |
| XLM-R LargeTransfer Strategy=Zero-Shot Cross-Lingual Transfer2025.01 | 36.31 | |
| X-MixupTransfer Strategy=Translate-Train, Base Model=Gemma 2 9B2025.01 | 35.45 | |
| X-MixupTransfer Strategy=Translate-Train, Base Model=Llama 3.1 8B2025.01 | 17.47 | |
| Llama 3.1 8BTransfer Strategy=Translate-Test2025.01 | 2.53 | |
| Gemma 2 9BTransfer Strategy=Zero-Shot Cross-Lingual Transfer2025.01 | 2.46 | |
| Llama 3.1 8BTransfer Strategy=Zero-Shot Cross-Lingual Transfer2025.01 | 2.36 | |
| Gemma 2 9BTransfer Strategy=Translate-Test2025.01 | 2.28 |