List your company

ResearchFormerly WizWand

BeaverTails

Benchmarks

TaskDatasetSOTA resultTrendResults

Safety Evaluation

BeaverTails (test)

7.9Harmful Score

110

Harmfulness Detection

BeaverTails bottom 30% uncertainty slice (test)

85.1AUROC

70

Safe-or-harmful binary classification

BeaverTails

84.6Accuracy

63

Multi-risk safety monitoring

BeaverTails

80.1Accuracy (%)

63

Harmful question-answering

BeaverTails HarmfulQA (1k and 10k samples)

0Avg Harmfulness Score

63

Text-based safety moderation

BeaverTails

87.3F1 Score

60

Response Harmfulness Detection

BeaverTails

89.9F1 Score

59

Harmful score evaluation

BeaverTails (test)

28.4Harmful Score

52

Safety Evaluation

BeaverTails

8.8ASR

44

Malicious Fine-tuning Defense

BeaverTails (test)

1Harmfulness Score

44

Safety Unlearning

BeaverTails

0Harmful Response Probability

42

Response Classification

BeaverTails V Text-Image Response

84.8F1 Score

39

Multi-label content safety classification

Beavertails

0.86F1 Score

35

Harmlessness evaluation

Beavertails

58.4Helpful Score

33

Beavertails

1.2Violation Rate

32

Safety Alignment

BeaverTails V

93.37Safety Score

27

Attack success evaluation

Beavertails

56.7Attack Success Rate

24

Adversarial Attack Robustness

BeaverTails

0Attack Success Rate

24

Value Alignment

BeaverTails (test)

59.9Value Alignment Score

24

Safety classification

BeaverTails (test)

94AUC

24

Multimodal Safety Evaluation

BeaverTails-V

2.9Safety Score

22

Safety Evaluation

Beavertails-V (test)

86.93Helpfulness Score

20

Safety Evaluation

BeaverTails Evaluation

1.24Harmful Score (HS)

20

Adversarial and Jailbreaking Attack Detection

BeaverTails

0.853AUROC

20

LLM Safety Evaluation

BeaverTails

9.88Ssafe Score

18