List your company

Agentic Coding on Dialo-SWE-Bench

58.8Resolution Rateschema-guided agent
21.77631.3884150.612Jun 12, 2026

Evaluation results

MethodLinks
schema-guided agentModel=GPT-5-mini, Open Weights=No2026.0658.88.439.40.24
schema-guided agentModel=GPT-5, Open Weights=No2026.065811.938.40.86
OH InteractiveModel=GPT-5, Open Weights=No2026.0654.617.1410.97
OH InteractiveModel=GPT-5-mini, Open Weights=No2026.0654.24.541.30.23
OpenHandsModel=GPT-5, Open Weights=No2026.0647.512.252.91.13
schema-guided agentModel=Average2026.0646.96.950.90.38
OH InteractiveModel=Average2026.0644.16.950.10.4
OH InteractiveModel=Devstral 2 Small (24B), Open Weights=Yes2026.0642.23.571.70.3
schema-guided agentModel=Devstral 2 Small (24B), Open Weights=Yes2026.0638.63.375.10.3
OpenHandsModel=GPT-5-mini, Open Weights=No2026.0634.32.148.80.26
OpenHandsModel=Average2026.0632.94.9610.48
schema-guided agentModel=Qwen 3 Coder (30-A-3B), Open Weights=Yes2026.0632.34510.13
OpenHandsModel=Devstral 2 Small (24B), Open Weights=Yes2026.0626.81.881.30.35
OH InteractiveModel=Qwen 3 Coder (30-A-3B), Open Weights=Yes2026.0625.42.646.30.12
OpenHandsModel=Qwen 3 Coder (30-A-3B), Open Weights=Yes2026.0623.23.660.80.18