ResearchDatasetsDevEvalDevEvalFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsDeveloper Knowledge EvaluationDevEval61Win Rate7Docstring EvaluationDevEval 183 human-written docstrings4.938Score5Agentic CodingDevEval94.8Solve Rate4Repository-level code generationDevEval442Inference Time4Terminal-related CLI agent taskDevEval39.74Accuracy2