Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Beaver dataset and benchmarks · SOTA2 Research

Research Datasets

Beaver

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Safety evaluation

Beaver

84.65Accuracy (Beaver Safety)

16

BEAVER Oracle dialect

36.4Execution Accuracy

9

Table Retrieval

BEAVER

43.5Capped Recall@25

9

Table Retrieval

BEAVER

32.6Recall@10

9

Table Retrieval

Beaver (dev)

17PR@5

8

Table Retrieval

BEAVER

23.1Recall@5

6

Safety Moderation

Beaver Response

84.4F1 Score

5

Safety Moderation

Beaver Prompt

77.2F1 Score

5

BEAVER

29.8Execution Accuracy (EX)

4

Popular tasks

Table Retrieval Safety Moderation Safety Evaluation Text-to-SQL NL2SQL

Follow for updates

Join SOTA2 Contact