Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

CATQA dataset and benchmarks · SOTA2 Research

Research Datasets

CATQA

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

CatQA

0ASR

20

Safety Evaluation

CATQA FigStep

100Safety Score

8

Safety Evaluation

CATQA Direct

1Safety Score (1-ASR)

8

Unsafety evaluation

CATQA

37.7Chinese Safety Score

8

Jailbreak Attack

CatQA-en

1.01Harmful Rate

6

Safety evaluation

CATQA Chinese (test)

55.67Chinese Accuracy

4

Safety evaluation

CATQA Vietnamese (test)

0.534Score (Chinese)

4

Safety Evaluation

CatQA-en (test)

1.66Harmful Content Rate

3

Popular tasks

Safety Evaluation Jailbreak Attack Red Teaming Unsafety evaluation

Follow for updates

Join SOTA2 Contact