List your company

Multilingual Medical Question Answering on MMedBench (test)

83.07Accuracy (Chinese)No-conflict
33.867646.641359.41572.1887May 21, 2025

Evaluation results

MethodLinks
No-conflictBackbone=Qwen1.5-7B2025.0583.0750.948.644.3857.8152.8856.27
KaFTBackbone=Qwen1.5-7B2025.0582.8151.6147.6640.6263.6752.6356.5
BaseBackbone=Qwen1.5-7B2025.0582.2546.1941.1235.6255.0849.0251.55
Self-aligningBackbone=Qwen1.5-7B2025.0582.1147.2946.1138.7558.5951.554.06
Vanilla SFTBackbone=Qwen1.5-7B2025.0579.1646.8245.4836.2561.7249.1253.09
KaFTBackbone=LLaMA3-8B2025.0560.1963.2458.8846.2563.676259.04
Self-aligningBackbone=LLaMA3-8B2025.0559.7860.4957.6345.6262.562.3158.09
No-conflictBackbone=LLaMA3-8B2025.0559.460.7258.5746.2562.561.4258.14
Vanilla SFTBackbone=LLaMA3-8B2025.0558.261.7457.0142.3863.6761.9357.49
BaseBackbone=LLaMA3-8B2025.0556.9858.6853.584055.8659.4854.1
No-conflictBackbone=LLaMA3-3B2025.0548.6353.5742.063551.1751.1746.93
KaFTBackbone=LLaMA3-3B2025.0548.2253.4246.1133.1251.9552.8147.61
Self-aligningBackbone=LLaMA3-3B2025.0547.7252.439.5633.1251.1750.9545.82
Vanilla SFTBackbone=LLaMA3-3B2025.0547.1453.140.8133.7551.9551.7946.42
BaseBackbone=LLaMA3-3B2025.0546.1549.6540.8128.1250.7849.3144.14
No-conflictBackbone=Mistral-7B2025.0541.7756.5649.8436.2562.556.250.52
KaFTBackbone=Mistral-7B2025.0541.3658.3748.2938.1262.1157.2250.91
Vanilla SFTBackbone=Mistral-7B2025.0541.0758.9948.293060.9458.0249.55
Self-aligningBackbone=Mistral-7B2025.0541.0454.9146.1132.561.3355.8748.63
BaseBackbone=Mistral-7B2025.0535.7651.0641.2426.8848.0549.2742.13