Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

OR-Bench dataset and benchmarks · SOTA2 Research

Research Datasets

OR-Bench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Refusal Evaluation

OR-Bench

99.6Toxic Refusal Rate

40

Over-refusal rate analysis

OR-Bench

16.68Over-refusal Rate

33

Safety Guardrailing

OR-Bench

0False Positive Rate

26

Over-refusal Evaluation

OR-Bench (boundary cases)

1.7OR-FPR

18

Overrefusal Detection

OR-Bench

93.42AUROC

18

Benign Prompt Filtering

OR-Bench

0False Positive Rate

12

Harmful Refusal

OR-Bench vani harm

98.5RTA

10

Guardrail False Positive Rate Estimation

OR-Bench benign prompts

0False Positive Rate

8

Safety Classification

OR-Bench

83.1F1 Score

8

Refusal Evaluation

OR-Bench Toxic

94.66Refusal Rate

7

Benign Over-refusal

OR-Bench Hard

11String-match Refusal Rate

6

Over-refusal evaluation

OR-Bench-Hard-1K (test)

60.6F1 Score

4

Safety and Utility Evaluation

OR-Bench

5.3HarmR

4

Adversarial Attack

OR-Bench unsafe inputs

88ASR

4

Popular tasks

Refusal Evaluation Over-refusal evaluation Adversarial Attack Safety Classification Overrefusal Detection

Follow for updates

Join SOTA2 Contact