Logical Coherence on CIAR
96AccuracyMetaCrit + GPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| MetaCrit + GPT-4oGroup=Ours, Base Model=GPT-4o, Monitoring agent (phi_up)=included, Control agent (phi_down)=included2025.07 | 96 | |
| MetaCrit + GPT-3.5-TurboGroup=Ours, Base Model=GPT-3.5-Turbo, Monitoring agent (phi_up)=included, Control agent (phi_down)=included2025.07 | 84 | |
| MEPGroup=Baselines, Base Model=GPT-3.5-Turbo2025.07 | 82 | |
| MetaCrit + Claude-3.5-SonnetGroup=Ours, Base Model=Claude-3.5-Sonnet, Monitoring agent (phi_up)=included, Control agent (phi_down)=included2025.07 | 74 | |
| MetaCrit + DeepSeek-v3Group=Ours, Base Model=DeepSeek-v3, Monitoring agent (phi_up)=included, Control agent (phi_down)=included2025.07 | 70 | |
| MetaCrit w/o ϕ↑Group=Ablation, Base Model=GPT-3.5-Turbo, Monitoring agent (phi_up)=excluded, Control agent (phi_down)=included2025.07 | 48 | |
| MetaCrit w/o ϕ↓Group=Ablation, Base Model=GPT-3.5-Turbo, Monitoring agent (phi_up)=included, Control agent (phi_down)=excluded2025.07 | 42 | |
| ExpertPromptingGroup=Baselines, Base Model=GPT-3.5-Turbo2025.07 | 38 | |
| MADGroup=Baselines, Base Model=GPT-3.5-Turbo2025.07 | 36 | |
| Universal Self-consistencyGroup=Baselines, Base Model=GPT-3.5-Turbo2025.07 | 30 | |
| Zero-shot-CoTGroup=Baselines, Base Model=GPT-3.5-Turbo2025.07 | 24 | |
| Self-refineGroup=Baselines, Base Model=GPT-3.5-Turbo2025.07 | 20 |