PIQA
Benchmarks
TaskDatasetSOTA resultTrendResults
PIQA
81.5Zero-shot PIQA Accuracy
30
PIQA zero-shot
76.93Accuracy
28
PIQA
31.3Percentage of Heads Zeroed
28
PIQA
80.69Accuracy
28
PIQA (test)
77.8Accuracy (PIQA)
27
PIQA 2020
80.96Accuracy (Normalized)
26
PIQA (out-of-domain)
70.84Accuracy
25
PIQA
0Delta Accuracy
24
PIQA
82.21Accuracy
20
PIQA
79Accuracy
20
PIQA (dev)
83.2Accuracy
19
PIQA
82.9Accuracy
17
PIQA
79.49PIQA Accuracy
17
PIQA
83.9PIQA Accuracy
16
PIQA
81.1PIQA Score
16
PIQA
60.66Accuracy
16
PIQA
0.152Mean Per-Step Regret
15
PIQA
81.3ACC
14
PIQA
93.74Accuracy
14
PIQA out-of-domain
19.1ROUGE-L
14
PIQA
73.56Normalized Accuracy
13
PIQA
74Accuracy
12
PIQA zero-shot
60.8Normalized Accuracy (zero-shot)
12
PIQA
59.9Exact Match
12
PIQA
3.28Perplexity
12