Algorithmic Reasoning on CLRS reference (OOD)
83.74DFSSPARK
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SPARKAverage MACs (K)=4532026.04 | 83.74 | 97.9 | 10.69 | 77.34 | 98.03 | 85.64 | 99.22 | 87.6 | 99.07 | 99.95 | 83.92 | |
| EoHAverage MACs (K)=4632026.04 | 77.27 | 95.03 | 4.25 | 65.9 | 96.22 | 80.51 | 97.44 | 84.56 | 98.14 | 95 | 79.43 | |
| FunSearchAverage MACs (K)=4692026.04 | 74.5 | 94.07 | 1.49 | 62.08 | 95.61 | 77.75 | 96.84 | 82.93 | 97.91 | 92.88 | 77.61 | |
| EvoPromptingAverage MACs (K)=4482026.04 | 68.14 | 93.46 | 0.79 | 41.86 | 95.05 | 75.35 | 97.3 | 85.75 | 98.4 | 88.12 | 74.42 | |
| CLRSAverage MACs (K)=4502026.04 | 46.78 | 88.32 | 0.47 | 43.43 | 95.18 | 76.36 | 96.05 | 80.51 | 97.78 | 87.27 | 71.22 | |
| SPARK-1itAverage MACs (K)=459, Search iterations=12026.04 | 45.6 | 73.04 | 9.57 | 51.56 | 97.54 | 79.79 | 97.8 | 86.89 | 99.02 | 84.94 | 72.58 | |
| OpenEvolveAverage MACs (K)=4812026.04 | 32.54 | 61.32 | 3.71 | 45.21 | 95.43 | 77.05 | 95.85 | 87.53 | 98.1 | 86.31 | 68.3 |