List your company
ResearchFormerly WizWand

Multilingual Language Understanding on MMMLU (test)

66.88AccuracyMSD (Off-Policy)
15.680828.972942.26555.5571May 3, 2026
Updated 5mo ago

Evaluation results

MethodLinks
MSD (Off-Policy)Base Model=Qwen-3-8B2026.0566.88
MSD (On-Policy)Base Model=Qwen-3-8B2026.0566.76
ORPOBase Model=Qwen-3-8B2026.0565.49
SimPoBase Model=Qwen-3-8B2026.0565.45
rDPOBase Model=Qwen-3-8B2026.0565.26
KTOBase Model=Qwen-3-8B2026.0565.23
R-DPOBase Model=Qwen-3-8B2026.0565.23
DPOBase Model=Qwen-3-8B2026.0565.15
SDRRLBase Model=Qwen-3-8B2026.0565.07
MPOBase Model=Qwen-3-8B2026.0564.78
RawBase Model=Qwen-3-8B2026.0564.65
PolyRefuseBase Model=Qwen-3-8B2026.0564.61
SFTBase Model=Qwen-3-8B2026.0559.22
MSD (On-Policy)Base Model=Qwen-2.5-7B-Instruct2026.0558.8
RawBase Model=Qwen-2.5-7B-Instruct2026.0558.26
MSD (Off-Policy)Base Model=Qwen-2.5-7B-Instruct2026.0558.25
MPOBase Model=Qwen-2.5-7B-Instruct2026.0558.17
R-DPOBase Model=Qwen-2.5-7B-Instruct2026.0558.06
DPOBase Model=Qwen-2.5-7B-Instruct2026.0558.04
rDPOBase Model=Qwen-2.5-7B-Instruct2026.0557.92
PolyRefuseBase Model=Qwen-2.5-7B-Instruct2026.0557.9
KTOBase Model=Qwen-2.5-7B-Instruct2026.0557.85
ORPOBase Model=Qwen-2.5-7B-Instruct2026.0557.47
SDRRLBase Model=Qwen-2.5-7B-Instruct2026.0557.34
SimPoBase Model=Qwen-2.5-7B-Instruct2026.0557.16
SFTBase Model=Qwen-2.5-7B-Instruct2026.0550.55
RawBase Model=LLaMA-3-8B-Instruct2026.0548.17
MSD (On-Policy)Base Model=LLaMA-3-8B-Instruct2026.0548.16
MPOBase Model=LLaMA-3-8B-Instruct2026.0547.87
MSD (Off-Policy)Base Model=LLaMA-3-8B-Instruct2026.0546.57
PolyRefuseBase Model=LLaMA-3-8B-Instruct2026.0544.01
R-DPOBase Model=LLaMA-3-8B-Instruct2026.0542.26
DPOBase Model=LLaMA-3-8B-Instruct2026.0541.53
SimPoBase Model=LLaMA-3-8B-Instruct2026.0535.31
ORPOBase Model=LLaMA-3-8B-Instruct2026.0534.88
SDRRLBase Model=LLaMA-3-8B-Instruct2026.0534.28
KTOBase Model=LLaMA-3-8B-Instruct2026.0533.79
RawBase Model=LLaMA-2-7B-Chat2026.0532.05
R-DPOBase Model=LLaMA-2-7B-Chat2026.0532.01
MSD (On-Policy)Base Model=LLaMA-2-7B-Chat2026.0531.97
rDPOBase Model=LLaMA-2-7B-Chat2026.0531.96
MPOBase Model=LLaMA-2-7B-Chat2026.0531.91
DPOBase Model=LLaMA-2-7B-Chat2026.0531.86
KTOBase Model=LLaMA-2-7B-Chat2026.0531.84
MSD (Off-Policy)Base Model=LLaMA-2-7B-Chat2026.0531.61
ORPOBase Model=LLaMA-2-7B-Chat2026.0531.49
SimPoBase Model=LLaMA-2-7B-Chat2026.0531.33
PolyRefuseBase Model=LLaMA-2-7B-Chat2026.0531.2
SDRRLBase Model=LLaMA-2-7B-Chat2026.0527.11
SFTBase Model=LLaMA-2-7B-Chat2026.0524
rDPOBase Model=LLaMA-3-8B-Instruct2026.0522.86
SFTBase Model=LLaMA-3-8B-Instruct2026.0517.65