Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Magicoder dataset and benchmarks · SOTA2 Research

Research Datasets

Magicoder

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Code-Specific Instruction Tuning Evaluation

Magicoder Evaluation Suite

54.27ARC-C Accuracy

48

Forgetting-aware Instruction Tuning

Magicoder Stability and Plasticity suites (test)

54.27ARC-C

36

Code Generation

Magicoder

5.86Speedup

12

Instruction Tuning

Magicoder HumanEval

50.84Stability

7

Magicoder (in-distribution)

0.851HV Score

6

Weight Poisoning Attack

Magicoder

98.38Strict ASR

3

Code Generation

Magicoder

98.38Strict ASR

2

Popular tasks

Code Generation LLM Routing Instruction Tuning Weight Poisoning Attack Forgetting-aware Instruction Tuning

Follow for updates

Join SOTA2 Contact