Code Generation on MBPP (Accuracy Before/After Delta)
55.2MBPP Accuracy (Pre-Exec)CausalFlow
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CausalFlow2026.05 | 55.2 | 76.4 | 21.2 | |
| Direct2026.05 | 51.4 | 51.4 | 0 | |
| Self-Reflection2026.05 | 51.4 | 78.9 | 27.4 | |
| Self-Refine2026.05 | 50.9 | 90.3 | 39.4 |