SocialIQA
Benchmarks
TaskDatasetSOTA resultTrendResults
SocialIQA
88.1Accuracy
164
SocialIQA
87.11Accuracy
150
SocialIQA
83.9Accuracy
30
SocialIQA (test)
75.49Accuracy
28
SocialIQA (SIQA) (val)
70.7Accuracy
24
SOCIALIQA (dev)
73.8Accuracy
11
SocialIQA (first 300 questions)
82.56Average Accuracy
10
SocialIQA (test)
78.1Accuracy
10
SocialIQA
0.81Kendall Correlation
10
SocialIQA
0.009MAE
7
SocialIQA (val)
72Exact Match
6
SocialIQA
100MHA
6
SocialIQA
87.3Preference Alignment
5
SocialIQA
75Adaptivity
4
SocialIQA
0.011RMSE
3
SocialIQA
100MHA
2
SocialIQA
60MHA
2
SocialIQA
94.7MHA
2
SocialIQA
66.2MHA
2