Error Detection on 74-paper benchmark (full)
55.4RecallOpenAIReview
Evaluation results
| Method | Links | |
|---|---|---|
| OpenAIReviewBackend=DeepSeek-V4-Flash2026.06 | 55.4 | |
| OpenAIReviewBackend=Grok-4.1-Fast2026.06 | 49.3 | |
| OpenAIReviewBackend=Qwen3.6-35B-A3B2026.06 | 46.2 | |
| zero-shotBackend=Grok-4.1-Fast2026.06 | 33.5 | |
| zero-shotBackend=Qwen3.6-35B-A3B2026.06 | 31.7 | |
| OpenAIReviewBackend=Gemini-3.1-Flash-Lite2026.06 | 30.9 | |
| zero-shotBackend=DeepSeek-V4-Flash2026.06 | 29.4 | |
| coarseBackend=DeepSeek-V4-Flash2026.06 | 21.2 | |
| coarseBackend=Qwen3.6-35B-A3B2026.06 | 15.9 | |
| coarseBackend=Grok-4.1-Fast2026.06 | 14.8 | |
| zero-shotBackend=Gemini-3.1-Flash-Lite2026.06 | 14.3 | |
| coarseBackend=Gemini-3.1-Flash-Lite2026.06 | 12.1 |