List your company

ResearchFormerly WizWand

Magicoder

Benchmarks

TaskDatasetSOTA resultTrendResults

Code-Specific Instruction Tuning Evaluation

Magicoder Evaluation Suite

54.27ARC-C Accuracy

48

Forgetting-aware Instruction Tuning

Magicoder Stability and Plasticity suites (test)

54.27ARC-C

36

Code Generation

Magicoder

5.86Speedup

12

Instruction Tuning

Magicoder HumanEval

50.84Stability

7

Magicoder (in-distribution)

0.851HV Score

6

Weight Poisoning Attack

Magicoder

98.38Strict ASR

3

Code Generation

Magicoder

98.38Strict ASR

2