List your company

Multilingual Ability Evaluation on MLQA, XLSUM, XQuAD, GMMLU

60.9MLQA F1LLAMA-3-8B
21.3831.6441.952.16Oct 21, 2024

Evaluation results

MethodLinks
LLAMA-3-8BPhase 1 (P1) Dataset=Instruct, Protocol=Two-phase Continual Fine-tuning, Evaluation Phase=P12024.1060.94.871.22540.5
LLAMA-3-8BPhase 1 (P1) Dataset=ALPACA, Phase 2 (P2) Dataset=ALPACA, Protocol=Two-phase Continual Fine-tuning, Evaluation Phase=P22024.1059.73.473.73442.7
LLAMA-3-8BFine-tuning Protocol=Dataset Mixture, Dataset Mixture=ALPACA MULTIALPACA2024.1048413.95028.9
LLAMA-3-8BPhase 1 (P1) Dataset=ALPACA, Phase 2 (P2) Dataset=ALPACA, Protocol=Two-phase Continual Fine-tuning, Evaluation Phase=P12024.1043.83.358.65339.7
MISTRAL-7BFine-tuning Protocol=Dataset Mixture, Dataset Mixture=ALPACA MULTIALPACA2024.1040.67.921.74127.8
LLAMA-3-8BPhase 1 (P1) Dataset=Instruct, Protocol=Two-phase Continual Fine-tuning, Evaluation Phase=P22024.1032.12.741.74430.1
MISTRAL-7BPhase 1 (P1) Dataset=Instruct, Phase 2 (P2) Dataset=MULTI, Protocol=Two-phase Continual Fine-tuning, Evaluation Phase=P22024.1030.73.343.64330.2
MISTRAL-7BPhase 1 (P1) Dataset=ALPACA, Protocol=Two-phase Continual Fine-tuning, Evaluation Phase=P22024.1028.8660.24033.8
MISTRAL-7BPhase 1 (P1) Dataset=Instruct, Phase 2 (P2) Dataset=MULTI, Protocol=Two-phase Continual Fine-tuning, Evaluation Phase=P12024.1024.61.235.14426.2
MISTRAL-7BPhase 1 (P1) Dataset=ALPACA, Protocol=Two-phase Continual Fine-tuning, Evaluation Phase=P12024.1022.91.2294223.8