Commonsense Reasoning
Benchmarks
TaskDatasetSOTA resultTrendResults
Commonsense Reasoning (BoolQ, PIQA, SIQA, HellaS., WinoG., ARC-e, ARC-c, OBQA) (test)
88BoolQ Accuracy
283
Commonsense Reasoning (BoolQ, PIQA, SIQA, HellaS., WinoG., ARC-e, ARC-c, OBQA)
89.69BoolQ Accuracy
245
Commonsense Reasoning
85Accuracy
57
Commonsense Reasoning
83.24BoolQ Accuracy
54
Commonsense Reasoning (BoolQ, PIQA, HellaSwag, Winogrande) zero-shot
84.9Avg Commonsense Accuracy
34
Commonsense Reasoning (PIQA, WinoG., HellaS., BoolQ, SIQA, OBQA) (test)
89.9PIQA Accuracy
32
Commonsense Reasoning (test)
88.2Overall Average Accuracy
31
Commonsense Reasoning
8Jaccard Index (J)
30
Commonsense Reasoning
75.1BoolQ Accuracy
27
Commonsense Reasoning Tasks (ARC-C, ARC-E, HellaSwag, LAMBADA, PIQA, WinoGrande)
41.47ARC-C Accuracy
25
Commonsense Reasoning
80.66WinoGrande Accuracy (WG)
24
Commonsense Reasoning (OBQA, ARC-C, Wino, PIQA, Social, ARC-E, BoolQ, Hella)
94.8OBQA
24
Commonsense Reasoning PIQA HellaSwag WinoGrande ARC-Easy OpenBookQA MathQA (test)
59Zero-shot Accuracy
21
Commonsense Reasoning
81.19ARC-E Accuracy
20
Commonsense Reasoning LLaMA2-7B
79.68Average Accuracy
18
Commonsense Reasoning Task
53.63HellaSwag Accuracy
12
Commonsense Reasoning 8 datasets
73.6BoolQ Accuracy
11
Commonsense Reasoning (CS)
82.7Accuracy
10
Commonsense Reasoning (lm-evaluation-harness) zero-shot
11.86LAMBADA Perplexity
10
Commonsense Reasoning (BoolQ, PIQA, SIQA, HellaSwag, WinoGrande, OBQA) LLaMA2 7B backbone (test)
88.5BoolQ Accuracy
10
Commonsense Reasoning MC+PEFT LLaMA3.2-1B (test)
62.4BoolQ Accuracy
8
Commonsense Reasoning (OpenBookQA, ARC-E, ARC-C, WinoGrande, PIQA, MathQA, HellaSwag)
34OpenBookQA
7
Commonsense Reasoning LLaMA-3.2-3B-Instruct (test)
76.1ARC-c
6
Commonsense Reasoning (HellaSwag, OBQA, WinoGrande, ARC, PIQA)
52.3HellaSwag
5
Commonsense Reasoning Tasks OpenLLM (test)
78.95Accuracy
4