ResearchTasksMulti-Agent Collaboration Role OversteppingFollowBenchmarksDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyDataset NameSOTA methodMetricTrendResultsLast UpdatedSWE total full set (dev)ChatDev0.2Overstepping Rate (<INFO>)4Apr 6, 2026SWE hard subset (dev)ChatDev0Overstepping Rate (<INFO>)4Apr 6, 2026SWE easy (dev)ChatDev0.4Overstepping Rate (<INFO>)4Apr 6, 2026