Therapeutic Quality Judging on Therapeutic quality evaluation dataset benchmark leaderboard · SOTA2 Research

Therapeutic Quality Judging on Therapeutic quality evaluation dataset

0.989ICC(C,1)TheraJudge

Evaluation Results

Method	Links
TheraJudge2026.06		0.989	0.948	0.981	0.05
TheraJudge2026.06		0.983	0.918	0.977	0.077
TheraJudge2026.06		0.96	0.9	0.929	0.085
TheraJudge2026.06		0.96	0.882	0.946	0.106
Best of Closed-Source2026.06		0.948	0.744	0.786	0.233
TheraJudge2026.06		0.945	0.694	0.934	0.291
TheraJudge2026.06		0.932	0.709	0.919	0.27
Qwen-2.5-7B-SFT2026.06		0.929	0.852	0.911	0.114
Qwen-2.5-7B-SFT2026.06		0.921	0.82	0.926	0.16
Best of Closed-Source2026.06		0.918	0.638	0.908	0.34
Best of Closed-Source2026.06		0.906	0.429	0.474	0.528
Best of Closed-Source2026.06		0.9	0.734	0.742	0.258
Qwen-2.5-7B-SFT2026.06		0.895	0.805	0.886	0.178
TheraJudge2026.06		0.879	0.561	0.848	0.901
Qwen-2.5-7B-SFT2026.06		0.874	0.459	0.866	0.518
Best of Closed-Source2026.06		0.871	0.636	0.592	0.302
Qwen-2.5-7B-ZS2026.06		0.87	0.471	0.712	0.453
Qwen-2.5-7B-SFT2026.06		0.803	0.646	0.743	0.216
Qwen-2.5-7B-ZS2026.06		0.802	0.573	0.669	0.376
Qwen-2.5-7B-ZS2026.06		0.761	0.394	0.74	0.493
Qwen-2.5-7B-SFT2026.06		0.76	0.636	0.695	0.175
Best of Closed-Source2026.06		0.73	0.394	0.743	0.594
Best of Closed-Source2026.06		0.685	0.333	0.597	0.628
Qwen-2.5-7B-ZS2026.06		0.65	0.45	0.499	0.374
Qwen-2.5-7B-ZS2026.06		0.616	0.164	0.602	0.544
Qwen-2.5-7B-SFT2026.06		0.605	0.429	0.451	0.242
Qwen-2.5-7B-ZS2026.06		0.519	0.31	0.263	0.292
Qwen-2.5-7B-ZS2026.06		0.145	0.015	0.079	0.427