Skip to content

Rankings Industries Companies Research Blog

Sign in List your company

ResearchFormerly WizWand

Papers Benchmarks Datasets Tasks

Research
Benchmarks
Symbolic Reasoning on Coinflip OOD: 3

Symbolic Reasoning on Coinflip OOD: 3

98.6AccuracyPaLM 540B

Updated 8mo ago

Evaluation results

Method	Links
PaLM 540B2022.12		98.6
T5 XXL2022.12		86.7
T5 XXL2022.12		13.1

State-of-the-art paper

PaLM 540B

Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

Dataset

Coinflip

Follow for updates

Join SOTA2 Contact

Related benchmarks

Arithmetic Reasoning on GSM8K (test)Arithmetic Reasoning on MAWPS (5-fold cross val)Arithmetic Reasoning on ASDiv (5-fold cross val)Symbolic Reasoning on Last Letter Concatenation OOD: 3 (test)Symbolic Reasoning on Last Letter Concatenation OOD: 4 (test)

Building an AI company?

Claim your profile, keep your facts current and see how buyers find you. Rankings are never paid for.

How rankings work List your company

Find AI companies and products for your business problem. Compare solutions and evidence by industry and task.

Explore

Rankings
Industries
Categories
Companies
Top AI companies

Read

Blog
Research
llms.txt

For AI companies

List your company
Claim a profile
Ranking badges

SOTA2 with AI

Claude connector
ChatGPT plugin
Tool reference
Connector privacy
Connector terms

SOTA2

Why SOTA2
How we rank
Contact

© 2026 SOTA2Built in Bellevue, USA