LLM-as-a-Judge on High-contrast response pairs
0.87Discriminability (πi)LongCat-Flash-Chat
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LongCat-Flash-ChatDiscriminability Level=High (pi_i >= 0.8)2026.04 | 0.87 | 0.307 | 10 | — | |
| Qwen3-235B-A22B-2507Discriminability Level=High (pi_i >= 0.8)2026.04 | 0.86 | 0.09 | 10 | — | |
| Grok-4-FastDiscriminability Level=High (pi_i >= 0.8)2026.04 | 0.85 | 0.035 | 10 | — | |
| Kimi-Linear-48B-A3B-InstructDiscriminability Level=High (pi_i >= 0.8)2026.04 | 0.85 | -0.043 | 10 | — | |
| Grok-3-MiniDiscriminability Level=High (pi_i >= 0.8)2026.04 | 0.85 | 0.1 | 10 | — | |
| Qwen3-235B-A22B-Thinking-2507Discriminability Level=High (pi_i >= 0.8)2026.04 | 0.85 | 0.124 | 10 | — | |
| Claude-Sonnet-4.5Discriminability Level=High (pi_i >= 0.8)2026.04 | 0.84 | -0.229 | 10 | — | |
| Kimi-Dev-72BDiscriminability Level=High (pi_i >= 0.8)2026.04 | 0.84 | -0.117 | 10 | — | |
| Llama-3.3-70B-InstructDiscriminability Level=High (pi_i >= 0.8)2026.04 | 0.84 | -0.151 | 10 | — | |
| Hunyuan-A13B-InstructDiscriminability Level=High (pi_i >= 0.8)2026.04 | 0.83 | -0.152 | 10 | — | |
| DeepSeek-V3.2Discriminability Level=High (pi_i >= 0.8)2026.04 | 0.82 | 0.226 | 10 | — | |
| DeepSeek-V3-0324Discriminability Level=High (pi_i >= 0.8)2026.04 | 0.82 | 0.024 | 10 | — | |
| Gemma-3-27BDiscriminability Level=High (pi_i >= 0.8)2026.04 | 0.81 | 0.152 | 10 | — | |
| Gemma-3-12BDiscriminability Level=Low (pi_i < 0.8)2026.04 | 0.78 | 0.181 | 10 | — | |
| Llama-3.1-8B-InstructDiscriminability Level=Low (pi_i < 0.8)2026.04 | 0.77 | -0.06 | 10 | — | |
| Mistral-NemoDiscriminability Level=Low (pi_i < 0.8)2026.04 | 0.75 | -0.052 | 10 | — | |
| DeepSeek-R1-0528Discriminability Level=Low (pi_i < 0.8)2026.04 | 0.55 | -0.097 | 0.184 | — | |
| GLM-4.5-AirDiscriminability Level=Low (pi_i < 0.8)2026.04 | 0.52 | 0.095 | 0.381 | — | |
| Llama-3.2-3B-InstructDiscriminability Level=Low (pi_i < 0.8)2026.04 | 0.51 | -0.001 | 0.46 | — | |
| Kimi-K2-ThinkingDiscriminability Level=Low (pi_i < 0.8)2026.04 | 0.51 | -0.102 | 0.457 | — |