Interdisciplinary Scientific Ideation on CHIMERA Takeaway-level
85.5InsightfulnessIDEA-CATALYST
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| IDEA-CATALYSTTop-k=12026.03 | 85.5 | 60.25 | 63.75 | |
| IDEA-CATALYSTTop-k=22026.03 | 85.16 | 62.42 | 66.45 | |
| × DecomposeTop-k=22026.03 | 84.88 | 61.63 | 66.82 | |
| × Potential RankingTop-k=32026.03 | 84.83 | 61.13 | 65.03 | |
| × Potential RankingTop-k=12026.03 | 84.71 | 59.4 | 64.16 | |
| IDEA-CATALYSTTop-k=32026.03 | 84.47 | 61.25 | 65.67 | |
| × Potential RankingTop-k=22026.03 | 84.28 | 59.97 | 64.18 | |
| × DecomposeTop-k=12026.03 | 84 | 60.75 | 65.25 | |
| × DecomposeTop-k=32026.03 | 83.8 | 65.32 | 70.13 | |
| + Conceptual RewritingTop-k=22026.03 | 83.71 | 61.94 | 67.1 | |
| + Conceptual RewritingTop-k=32026.03 | 83.19 | 62.82 | 66.95 | |
| + Conceptual RewritingTop-k=12026.03 | 82 | 59.75 | 66.25 | |
| Guided DualTop-k=22026.03 | 74.19 | 59.68 | 63.23 | |
| Guided DualTop-k=12026.03 | 73 | 62.25 | 66.75 | |
| Guided DualTop-k=32026.03 | 72.36 | 60.54 | 64.39 | |
| Free-Form SourceTop-k=32026.03 | 27.35 | 51.57 | 50.14 | |
| Free-Form SourceTop-k=22026.03 | 23.06 | 51.45 | 48.06 | |
| Free-Form SourceTop-k=12026.03 | 18.25 | 47.75 | 44.25 |