Pairwise preference evaluation on Common2sense
61Context 1 Preference ScoreANCHOR
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ANCHORModel=Qwen2.5-72B2026.05 | 61 | 61.1 | 27.8 | 60.6 | 99.95 | |
| ANCHORModel=Qwen2.5-32B2026.05 | 60.2 | 58.3 | 14.6 | 56.3 | 99.79 | |
| CompareModel=GPT-42026.05 | 58.7 | 54.8 | 30.2 | 55.6 | — | |
| CompareModel=Qwen2.5-32B2026.05 | 58.3 | 48 | 22.1 | 47.7 | — | |
| BIRDModel=Qwen2.5-72B, Mapping condition=relaxed2026.05 | 56.8 | 52.3 | 30.6 | 52.6 | 99.99 | |
| CompareModel=Qwen2.5-72B2026.05 | 56.6 | 57 | 26.7 | 53.4 | — | |
| CompareModel=DeepSeek-V3-671B2026.05 | 56 | 57.8 | 28.6 | 54.2 | — | |
| Factor-basedModel=Qwen2.5-32B2026.05 | 55.6 | 56.4 | 5.4 | 52.5 | — | |
| Factor-basedModel=DeepSeek-V3-671B2026.05 | 55.3 | 54.6 | 16.5 | 50.6 | — | |
| VanillaModel=Qwen2.5-32B2026.05 | 52.8 | 52.8 | 21.1 | 46.2 | — | |
| VanillaModel=Qwen2.5-72B2026.05 | 52.6 | 52.8 | 18.3 | 47 | — | |
| LogitsModel=Qwen2.5-72B2026.05 | 52.3 | 50 | 15.6 | 44.7 | — | |
| LogitsModel=DeepSeek-V3-671B2026.05 | 51.6 | 51.3 | 16.2 | 45.3 | — | |
| Factor-basedModel=Qwen2.5-72B2026.05 | 50.9 | 50.9 | 25 | 49.6 | — | |
| LogitsModel=Qwen2.5-32B2026.05 | 50.4 | 49.1 | 15 | 44.5 | — | |
| BIRDModel=Qwen2.5-72B, Mapping condition=original2026.05 | 49.7 | 41.2 | 27.1 | 42.1 | 87.77 | |
| VanillaModel=DeepSeek-V3-671B2026.05 | 48.9 | 49.8 | 13.7 | 42.5 | — | |
| CoTModel=DeepSeek-V3-671B2026.05 | 41.4 | 39.5 | 14.6 | 33.8 | — | |
| CoTModel=Qwen2.5-32B2026.05 | 39.4 | 37 | 11.8 | 31.9 | — | |
| CoTModel=Qwen2.5-72B2026.05 | 37 | 38.2 | 15.9 | 31.1 | — | |
| RandomModel=Guess2026.05 | 33.3 | 33.3 | 33.3 | 33.3 | — |