Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

CodeAlpaca dataset and benchmarks · SOTA2 Research

Research Datasets

CodeAlpaca

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Code generation

CodeAlpaca

5.67Average Speed-up

41

Code Generation

CodeAlpacaPy

3.23Speedup

24

Code Generation

CodeAlpaca 20k

0.597NLL

20

Evol-CodeAlpaca

234.09p90 Latency (ms/token)

12

Code Generation

CodeAlpaca

53.66Pass@1

11

Code Generation

CodeAlpaca

0.543CodeBLEU

10

Code Generation

CodeAlpaca

33.2Score

9

Backdoor Attack

CodeAlpaca-20k (test)

90.5ASR

5

Backdoor Attack

CodeAlpaca 20k code generation instructions

94.8ASR

5

Code Generation

CodeAlpaca code-generation (test)

4.12Perplexity (PPL)

5

Popular tasks

Code Generation Backdoor Attack LLM Serving

Follow for updates

Join SOTA2 Contact