List your company

ResearchFormerly WizWand

CodeAlpaca

Benchmarks

TaskDatasetSOTA resultTrendResults

Code generation

CodeAlpaca

5.67Average Speed-up

41

Code Generation

CodeAlpacaPy

3.23Speedup

24

Code Generation

CodeAlpaca 20k

0.597NLL

20

Evol-CodeAlpaca

234.09p90 Latency (ms/token)

12

Code Generation

CodeAlpaca

53.66Pass@1

11

Code Generation

CodeAlpaca

0.543CodeBLEU

10

Code Generation

CodeAlpaca

33.2Score

9

Backdoor Attack

CodeAlpaca-20k (test)

90.5ASR

5

Backdoor Attack

CodeAlpaca 20k code generation instructions

94.8ASR

5

Code Generation

CodeAlpaca code-generation (test)

4.12Perplexity (PPL)

5