Functional Correctness on SMILES
4.2U Success RateDreamCoder
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DreamCoderSteps=162026.05 | 4.2 | 4.2 | 4.2 | 4.2 | 4.2 | |
| DreamSteps=1282026.05 | 3.6 | 4.2 | 4.2 | 4.2 | 4.2 | |
| DreamCoderSteps=322026.05 | 3.6 | 4.2 | 4.2 | 4.2 | 4.2 | |
| DreamSteps=322026.05 | 3 | 3 | 3 | 3 | 3 | |
| DreamSteps=642026.05 | 3 | 3.6 | 3.6 | 3.6 | 3.6 | |
| DreamSteps=2562026.05 | 3 | 4.2 | 4.2 | 4.2 | 4.2 | |
| DreamCoderSteps=642026.05 | 2.4 | 2.4 | 2.4 | 2.4 | 2.4 | |
| DreamCoderSteps=1282026.05 | 2.4 | 2.4 | 2.4 | 2.4 | 2.4 | |
| DreamCoderSteps=2562026.05 | 2.4 | 2.4 | 2.4 | 2.4 | 2.4 | |
| LLaDASteps=2562026.05 | 2.4 | 2.4 | 2.4 | 2.4 | 2.4 | |
| DiffuCoderSteps=2562026.05 | 2.4 | 2.4 | 2.4 | 2.4 | 2.4 | |
| LLaDASteps=1282026.05 | 1.8 | 1.8 | 1.8 | 1.8 | 1.8 | |
| DiffuCoderSteps=1282026.05 | 1.8 | 1.8 | 1.8 | 1.8 | 1.8 | |
| LLaDASteps=162026.05 | 1.2 | 1.8 | 1.8 | 1.8 | 1.8 | |
| LLaDASteps=642026.05 | 1.2 | 1.8 | 1.8 | 1.8 | 1.8 | |
| DreamSteps=162026.05 | 0.6 | 0.6 | 0.6 | 0.6 | 0.6 | |
| LLaDASteps=322026.05 | 0.6 | 1.2 | 1.2 | 1.2 | 1.2 | |
| DiffuCoderSteps=642026.05 | 0.6 | 0.6 | 0.6 | 0.6 | 0.6 | |
| DiffuCoderSteps=162026.05 | 0 | 0.6 | 0.6 | 0.6 | 0.6 | |
| DiffuCoderSteps=322026.05 | 0 | 0 | 0 | 0 | 0 |