PIQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
PIQA leave-one-out setup
88.5Average Accuracy
12
PIQA
79.71PIQA Normalized Performance
12
PIQA
0.5Accuracy Delta
12
PIQA
2.05Accuracy Improvement
12
PIQA
68.39Normalized Accuracy
11
PIQA
75.52Character-level Accuracy
11
PIQA
77.31Accuracy (Baseline)
11
PIQA In-Domain
89Accuracy
10
PIQA
79.8Accuracy (PIQA)
10
PIQA non-IID distribution, alpha=0.1
74.1Accuracy
10
PIQA IID distribution
81.15Accuracy
10
Global PIQA
95.6Score (Global PIQA)
9
PIQA
80.25PIQA Accuracy
9
PIQA
0.8Accuracy Delta
9
PIQA Corrupt Setting
61.9Accuracy
8
PIQA Clean Setting
84.2Accuracy
8
PIQA
81.8Accuracy
8
PIQA
84Accuracy
8
Piqa
73.61Normalized Accuracy
8
PIQA (val test)
79.42Accuracy
8
PIQA
0.008MAE
7
PIQA
72.6Accuracy
7
PIQA (test)
90.8Accuracy
6
PIQA (out-of-domain)
82.22Accuracy
6
PIQA
79.8Accuracy (0-shot)
6