Description-Code Inconsistency Detection on Dsyn
40Mis CountDCIChecker
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| DCICheckerCategory=DCI Detection2026.06 | 40 | 40 | 38 | 26 | 144 | 40 | 40 | 39 | 119 | 263 | |
| MCPDiFFCategory=DCI Detection2026.06 | 12 | 11 | 20 | 3 | 46 | 38 | 2 | 26 | 66 | 112 | |
| Agent ScanCategory=MCP Scanner2026.06 | 11 | 14 | 10 | 8 | 43 | 5 | 9 | 12 | 26 | 69 | |
| MCP-ShieldCategory=MCP Scanner2026.06 | 2 | 1 | 0 | 2 | 5 | 1 | 1 | 1 | 3 | 8 | |
| BanditCategory=Static Analyzer2026.06 | 1 | 9 | 6 | 1 | 17 | 31 | 2 | 8 | 41 | 58 | |
| SemgrepCategory=Static Analyzer2026.06 | 0 | 1 | 1 | 0 | 2 | 9 | 0 | 1 | 10 | 12 |