List your company
ResearchFormerly WizWand

Instruction Following on AlpacaEval Swahili

83Win RateCLO
33.49646.34859.272.052May 20, 2025
Updated 8mo ago

Evaluation results

MethodLinks
CLOModel=Llama-3-8B, Eval Lang=Target2025.058317.6
CLOModel=Qwen-2.5-3B, Eval Lang=Target2025.0574.723
CLOModel=Llama-2-13B, Eval Lang=Target2025.0570.917
SFT+DPOModel=Llama-3-8B, Eval Lang=Target2025.0565.4—
CLOModel=Llama-2-7B, Eval Lang=Target2025.05650.9
CLOModel=Mistral-7B-v0.1, Eval Lang=English2025.0564.213
SFT+DPOModel=Llama-2-7B, Eval Lang=Target2025.0564.1—
CLOModel=Llama-3-8B, Eval Lang=English2025.0561.411.1
CLOModel=Qwen-2.5-3B, Eval Lang=English2025.0558.17
CLOModel=Llama-2-7B, Eval Lang=English2025.0555.54
CLOModel=Llama-2-13B, Eval Lang=English2025.05554.2
SFT+DPOModel=Llama-2-13B, Eval Lang=Target2025.0553.9—
SFT+DPOModel=Qwen-2.5-3B, Eval Lang=Target2025.0551.7—
SFT+DPOModel=Llama-2-7B, Eval Lang=English2025.0551.5—
CLOModel=Mistral-7B-v0.1, Eval Lang=Target2025.0551.315.9
SFT+DPOModel=Mistral-7B-v0.1, Eval Lang=English2025.0551.2—
SFT+DPOModel=Qwen-2.5-3B, Eval Lang=English2025.0551.1—
SFT+DPOModel=Llama-2-13B, Eval Lang=English2025.0550.8—
SFT+DPOModel=Llama-3-8B, Eval Lang=English2025.0550.3—
SFT+DPOModel=Mistral-7B-v0.1, Eval Lang=Target2025.0535.4—