Evaluator Preference Collapse Analysis on Multimodal EPC Phase 1 Overall
1.464PCIGPT-4o
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GPT-4oEvaluator=GPT-4o2026.06 | 1.464 | 1.449 | 2.04 | 3.18 | |
| RandomRounds=16r2026.06 | 0.716 | — | 1 | 1.55 | |
| DeepSeekEvaluation Strategy=self-eval2026.06 | 0.461 | — | 0.64 | 1 | |
| Ground truthEvaluation Strategy=deterministic correctness check2026.06 | 0.251 | — | 0.35 | 0.54 |