Synthesis Correctness on IDS suite LCC
1Pass RateIDS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| IDS2026.05 | 1 | 10 | 136 | |
| Codex2026.05 | 0 | 13 | 180 | |
| Claude Code2026.05 | 0 | 11 | 160 |
Loading the SOTA2 catalog…
| Method | Links | |||
|---|---|---|---|---|
| IDS2026.05 | 1 | 10 | 136 | |
| Codex2026.05 | 0 | 13 | 180 | |
| Claude Code2026.05 | 0 | 11 | 160 |