Medical Diagnostic Reasoning on MedCaseReasoning official 897-case (test)
32.83AccuracyGRPO
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GRPOCategory=RL, Backbone=LLaMA3.1-8B-Instruct2026.04 | 32.83 | 73.24 | |
| GRPOCategory=RL, Backbone=Qwen2.5-7B-Instruct2026.04 | 32.81 | 73.12 | |
| CGCLCategory=Ours, Backbone=LLaMA3.1-8B-Instruct2026.04 | 32.67 | 72.89 | |
| CGCLCategory=Ours, Backbone=Qwen2.5-7B-Instruct2026.04 | 32.63 | 72.84 | |
| DPOCategory=RL, Backbone=LLaMA3.1-8B-Instruct2026.04 | 32.29 | 71.22 | |
| DPOCategory=RL, Backbone=Qwen2.5-7B-Instruct2026.04 | 32.24 | 71.18 | |
| SFT-CoTCategory=SFT, Backbone=LLaMA3.1-8B-Instruct2026.04 | 32.14 | 60.86 | |
| SFT-CoTCategory=SFT, Backbone=Qwen2.5-7B-Instruct2026.04 | 32.08 | 60.79 | |
| SFT-GTCategory=SFT, Backbone=LLaMA3.1-8B-Instruct2026.04 | 31.79 | 63.81 | |
| SFT-GTCategory=SFT, Backbone=Qwen2.5-7B-Instruct2026.04 | 31.72 | 63.74 | |
| SFT-CGCL(Stage3)Category=SFT, Backbone=Qwen2.5-7B-Instruct2026.04 | 30.12 | 70.78 | |
| SFT-CGCL(Stage3)Category=SFT, Backbone=LLaMA3.1-8B-Instruct2026.04 | 30.07 | 70.92 | |
| CGCLCategory=Ours, Backbone=Qwen2.5-3B-Instruct2026.04 | 28.95 | 71.3 | |
| GRPOCategory=RL, Backbone=LLaMA3.2-3B-Instruct2026.04 | 28.95 | 71.3 | |
| GRPOCategory=RL, Backbone=Qwen2.5-3B-Instruct2026.04 | 28.9 | 71.25 | |
| CGCLCategory=Ours, Backbone=LLaMA3.2-3B-Instruct2026.04 | 28.9 | 71.35 | |
| DPOCategory=RL, Backbone=LLaMA3.2-3B-Instruct2026.04 | 28.63 | 69.31 | |
| DPOCategory=RL, Backbone=Qwen2.5-3B-Instruct2026.04 | 28.59 | 69.27 | |
| SFT-CoTCategory=SFT, Backbone=LLaMA3.2-3B-Instruct2026.04 | 28.33 | 59.91 | |
| SFT-CoTCategory=SFT, Backbone=Qwen2.5-3B-Instruct2026.04 | 28.27 | 59.83 | |
| SFT-GTCategory=SFT, Backbone=Qwen2.5-3B-Instruct2026.04 | 28.16 | 62.38 | |
| SFT-GTCategory=SFT, Backbone=LLaMA3.2-3B-Instruct2026.04 | 28.12 | 62.49 | |
| SFT-CGCL(Stage3)Category=SFT, Backbone=LLaMA3.2-3B-Instruct2026.04 | 26.64 | 68.59 | |
| SFT-CGCL(Stage3)Category=SFT, Backbone=Qwen2.5-3B-Instruct2026.04 | 26.58 | 68.67 | |
| Trust-Think & AnswerCategory=Prompt, Backbone=LLaMA3.1-8B-Instruct2026.04 | 26.38 | 65.47 | |
| Trust-Think & AnswerCategory=Prompt, Backbone=Qwen2.5-7B-Instruct2026.04 | 26.31 | 65.52 | |
| Think & AnswerCategory=Prompt, Backbone=LLaMA3.1-8B-Instruct2026.04 | 25.73 | 62.58 | |
| Think & AnswerCategory=Prompt, Backbone=Qwen2.5-7B-Instruct2026.04 | 25.68 | 62.43 | |
| Think & AnswerCategory=Prompt, Backbone=LLaMA3.2-3B-Instruct2026.04 | 23.51 | 61.29 | |
| Think & AnswerCategory=Prompt, Backbone=Qwen2.5-3B-Instruct2026.04 | 23.47 | 61.32 | |
| Trust-Think & AnswerCategory=Prompt, Backbone=LLaMA3.2-3B-Instruct2026.04 | 23.43 | 63.36 | |
| Trust-Think & AnswerCategory=Prompt, Backbone=Qwen2.5-3B-Instruct2026.04 | 23.42 | 63.28 | |
| VanillaCategory=Prompt, Backbone=LLaMA3.1-8B-Instruct2026.04 | 22.46 | — | |
| VanillaCategory=Prompt, Backbone=Qwen2.5-7B-Instruct2026.04 | 22.37 | — | |
| VanillaCategory=Prompt, Backbone=Qwen2.5-3B-Instruct2026.04 | 20.61 | — | |
| VanillaCategory=Prompt, Backbone=LLaMA3.2-3B-Instruct2026.04 | 20.57 | — |