Idea Novelty Evaluation on 100 ICLR 2026 problem seeds (test)
3.73Mean NoveltyGPT-5.5
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| GPT-5.5configuration=bare2026.07 | 3.73 | 0.53 | 2 | 2 | 77 | 214 | 5 | |
| IdeaSparkbackbone=Opus-4.82026.07 | 2.92 | 0.53 | 1 | 53 | 216 | 30 | 0 | |
| Opus-self-genbackbone=Opus-4.8, retrieval=live retrieval2026.07 | 2.86 | 0.5 | 1 | 59 | 222 | 18 | 0 | |
| Opus-4.8configuration=bare, backbone=Opus-4.82026.07 | 2.32 | 0.6 | 19 | 168 | 110 | 3 | 0 |