Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Counterfactual Eval dataset and benchmarks · SOTA2 Research

Research Datasets

Counterfactual Eval

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Counterfactual Reasoning

Counterfactual Eval (dev)

63.4Mean Score

52

Logical and Mathematical Reasoning under Counterfactuals

Counterfactual Eval Manual Initialization 5 random samples 1.0 (train and dev)

32Arithmetic Base 8 (Mean)

4

Popular tasks

Counterfactual reasoning Logical and Mathematical Reasoning under Counterfactuals

Follow for updates

Join SOTA2 Contact