Synthesis Correctness on IDS suite Monotonic Reads
3Pass RateIDS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| IDS2026.05 | 3 | 7 | 102 | |
| Codex2026.05 | 0 | 12 | 130 | |
| Claude Code2026.05 | 0 | 10 | 140 |
Loading the SOTA2 catalog…
| Method | Links | |||
|---|---|---|---|---|
| IDS2026.05 | 3 | 7 | 102 | |
| Codex2026.05 | 0 | 12 | 130 | |
| Claude Code2026.05 | 0 | 10 | 140 |