Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

SocialIQA dataset and benchmarks · SOTA2 Research

Research Datasets

SocialIQA

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Commonsense Reasoning

SocialIQA

88.1Accuracy

164

Social Commonsense Reasoning

SocialIQA

87.11Accuracy

150

Question Answering

SocialIQA

83.9Accuracy

30

Social Interaction Question Answering

SocialIQA (test)

75.49Accuracy

28

Commonsense Question Answering

SocialIQA (SIQA) (val)

70.7Accuracy

24

Commonsense Reasoning

SOCIALIQA (dev)

73.8Accuracy

11

Multi-agent Question Answering

SocialIQA (first 300 questions)

82.56Average Accuracy

10

Question Answering

SocialIQA (test)

78.1Accuracy

10

Ranking correlation with full dataset evaluation

SocialIQA

0.81Kendall Correlation

10

Scaling Law Prediction

SocialIQA

0.009MAE

7

Question Answering

SocialIQA (val)

72Exact Match

6

Inference correction review (discard)

SocialIQA

100MHA

6

Preference alignment

SocialIQA

87.3Preference Alignment

5

SocialIQA

75Adaptivity

4

Downstream accuracy extrapolation

SocialIQA

0.011RMSE

3

Inference correction review (reason)

SocialIQA

100MHA

2

Timing comparison

SocialIQA

60MHA

2

Event/state classification

SocialIQA

94.7MHA

2

Triplet classification

SocialIQA

66.2MHA

2

Popular tasks

Question Answering Commonsense Reasoning Preference Alignment Commonsense Question Answering Social Interaction Question Answering

Follow for updates

Join SOTA2 Contact