List your company

ResearchFormerly WizWand

InterCode

Benchmarks

TaskDatasetSOTA resultTrendResults

Interactive Decision Making

InterCode NL2Bash

79.6Success Rate

40

SQL Code Generation

InterCode SQL

64.01Success Rate

27

Bash Command Execution

InterCode Bash

72Execution Success Rate

24

Cybersecurity (CTF)

InterCode CTF

57Success Rate

20

Policy Enforcement

Intercode

100Utility

12

interactive SQL querying

InterCode SQL

69.1Avg Reward

10

Interactive Code Execution

InterCode

64.01Bash Success Rate

7

Probabilistic Verification

Intercode

221Average Latency (ms)

2