P3
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
P3 Real-world Deployment (Tasks 1-6)
100Success Rate
15
P3 Pepper
20.48SNR
12
P3 v1 (unseen)
80.83RTE Accuracy
11
P3 Real-world Deployment (Tasks 7-11)
92.86Success Rate
10
P3
1.28Log10 Median Utility Gap
10
P3
92.7Normalized Fitness
6
P3 v1 (test)
1.59Overall MSE
6
P3
53.3WiC Score
5
P3
61.6Winogrades Score
5
P3
85.3COPA Accuracy
5
P3
81.3RTE
5
P3
77.6Dream
5
P3
7.8Mul. News Score
5
P3
49.4Emotion Accuracy
5
P3.5P focal
2,043Template Size (R×C)
4