Program Synthesis on HumanEval-EvalPlus Standard (test)
89.6pass@1QualityFlow
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| QualityFlowLLM Backbone=Claude Sonnet-3.5-v22025.01 | 89.6 | 3 | |
| Instruct-Turbo2025.01 | 86.6 | — |
Loading the SOTA2 catalog…
| Method | Links | ||
|---|---|---|---|
| QualityFlowLLM Backbone=Claude Sonnet-3.5-v22025.01 | 89.6 | 3 | |
| Instruct-Turbo2025.01 | 86.6 | — |