Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Code dataset and benchmarks – Page 2 · SOTA2 Research

Research Datasets

Code

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Code Generation

Code

86.9ASR

7

Language Modeling

Code

5.5Perplexity

6

Speculative Decoding

Code

2.38Speedup

6

Code Generation

Code (test)

36.5Accuracy

6

Misaligned Task Learning

Code In-domain

56.67Misalignment

6

Emergent Misalignment Measurement

Code

0Misalignment

6

Critique Quality Evaluation

Code

67.5Win Rate

6

Code Generation

Code

87.7MTP Acceptance Rate

5

ECG Classification

CODE 15%

96.6Macro AUROC

5

Code

2Coverage Loss

5

Language Modeling

Code 24B tokens

0.699Cross-Entropy Loss

5

Code Generation and Reasoning

Code Domain Average

73.7Accuracy

4

CODE (test)

3.62Turns

4

Code Generation

CODE

99F1 Score

4

Code

1,694.26Average Tokens per Sample

3

Code Generation

Code

183.54Throughput (token/s)

3

Representation coupling evaluation via mean coupling diagnostic

Code

98.6Mean Coupling

2

Zero-shot transfer attack

Code

95.9Attack Success Rate (ASR)

2

Page 2 of 2

Popular tasks

Code Generation Speculative Decoding Language Modeling ECG Classification AI-generated text detection

Follow for updates

Join SOTA2 Contact