Binary Outcome Discrimination on Resolved vs. Rest (test) benchmark leaderboard · SOTA2 Research

Binary Outcome Discrimination on Resolved vs. Rest (test)

90.1AUCQwen2.5-Coder-7B

Evaluation Results

Method	Links
Qwen2.5-Coder-7B2026.06		90.1	79.4
Qwen2.5-Coder-14B2026.06		88.3	82.7
Qwen3-4B-Base2026.06		88.2	74.8
Qwen3-8B-Base2026.06		87.7	79.5
Qwen2.5-Coder-1.5B2026.06		87.5	57.7
CodeLlama-7B2026.06		87.5	58.6
Qwen2.5-7B2026.06		86.6	67.3
Qwen2.5-Coder-3B2026.06		86.3	70.2
Qwen3-1.7B-Base2026.06		86.3	61.3
Qwen2.5-1.5B2026.06		86.2	55.7
All2026.06		85	61.9
Qwen2.5-Coder-0.5B2026.06		84.7	46.4
DeepSeek-Coder-6.7B2026.06		84.1	71.2
Llama-2-7B2026.06		83.8	50.4
Qwen3-0.6B-Base2026.06		80.8	52.2
Qwen2.5-0.5B2026.06		77.1	45
Qwen2.5-3B2026.06		76.4	55.3