Code Generation on MBPP (Cost, Acc, Eff)
0.37Cost4B Iterative (Lower Bound)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| 4B Iterative (Lower Bound)Ratio (S:L)=100:02026.02 | 0.37 | 80.1 | 216.5 | |
| Random SamplingRouting Mode=Static Routing, Ratio (S:L)=96:042026.02 | 0.45 | 81.3 | 180.7 | |
| Decision Tree (Gini, Depth=5)Ratio (S:L)=96:042026.02 | 0.46 | 82.2 | 178.7 | |
| Random Sampling (Online Ratio)Routing Mode=Online Adaptation, Ratio (S:L)=85:152026.02 | 0.68 | 88.3 | 129.9 | |
| Adaptive Hoeffding TreeRouting Mode=Online Adaptation, Ratio (S:L)=85:152026.02 | 0.69 | 91.3 | 132.3 | |
| 32B Iterative (Upper Bound)Ratio (S:L)=0:1002026.02 | 1.18 | 94 | 79.7 |