Research domain
Code & Developer AI
Code Generation986 benchmarks · 973 papersGenerative Modeling227 benchmarks · 111 papersText-to-SQL149 benchmarks · 138 papersCoding146 benchmarks · 139 papersVulnerability Detection139 benchmarks · 60 papersSoftware Engineering61 benchmarks · 66 papersCode Reasoning53 benchmarks · 66 papersCode44 benchmarks · 45 papersBug Detection41 benchmarks · 6 papersCompetitive Programming37 benchmarks · 26 papersSymbolic Execution33 benchmarks · 1 papersCode Coverage Analysis31 benchmarks · 3 papersHLS Code Generation31 benchmarks · 1 papersCode Completion28 benchmarks · 21 papersProgram synthesis28 benchmarks · 18 papersFirmware Code Coverage Analysis28 benchmarks · 2 papersAgentic Coding28 benchmarks · 18 papersCode Translation27 benchmarks · 15 papersCode Summarization26 benchmarks · 16 papersInformation Flow Verification24 benchmarks · 1 papersDefect Detection23 benchmarks · 15 papersSoftware Engineering Skill Evaluation22 benchmarks · 1 papersGeneral AI Assistant Tasks22 benchmarks · 30 papersSIEM Rule Conversion20 benchmarks · 1 papersMalicious Package Detection20 benchmarks · 8 papersEdge Coverage20 benchmarks · 1 papersSecure Code Generation20 benchmarks · 14 papersCoding Reasoning19 benchmarks · 13 papersState register identification17 benchmarks · 1 papersPerformance and code size impact evaluation17 benchmarks · 1 papersVulnerability Discovery17 benchmarks · 7 papersCFG Recovery and Library Detection16 benchmarks · 1 papers