List your company

ResearchFormerly WizWand

OR-Bench

Benchmarks

TaskDatasetSOTA resultTrendResults

Refusal Evaluation

OR-Bench

99.6Toxic Refusal Rate

40

Over-refusal rate analysis

OR-Bench

16.68Over-refusal Rate

33

Safety Guardrailing

OR-Bench

0False Positive Rate

26

Over-refusal Evaluation

OR-Bench (boundary cases)

1.7OR-FPR

18

Overrefusal Detection

OR-Bench

93.42AUROC

18

Benign Prompt Filtering

OR-Bench

0False Positive Rate

12

Harmful Refusal

OR-Bench vani harm

98.5RTA

10

Guardrail False Positive Rate Estimation

OR-Bench benign prompts

0False Positive Rate

8

Safety Classification

OR-Bench

83.1F1 Score

8

Refusal Evaluation

OR-Bench Toxic

94.66Refusal Rate

7

Benign Over-refusal

OR-Bench Hard

11String-match Refusal Rate

6

Over-refusal evaluation

OR-Bench-Hard-1K (test)

60.6F1 Score

4

Safety and Utility Evaluation

OR-Bench

5.3HarmR

4

Adversarial Attack

OR-Bench unsafe inputs

88ASR

4