Synthesis Correctness on IDS suite Causal Consistency
2Pass RateIDS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| IDS2026.05 | 2 | 11 | 155 | |
| Codex2026.05 | 0 | 12 | 160 | |
| Claude Code2026.05 | 0 | 11 | 170 |
Loading the SOTA2 catalog…
| Method | Links | |||
|---|---|---|---|---|
| IDS2026.05 | 2 | 11 | 155 | |
| Codex2026.05 | 0 | 12 | 160 | |
| Claude Code2026.05 | 0 | 11 | 170 |