ProofNet
Benchmarks
TaskDatasetSOTA resultTrendResults
ProofNet
94.1Compilation Pass Rate@10
28
ProofNet (test)
21.5Pass Rate (%)
27
ProofNet
24.26Accuracy
26
ProofNet (test)
32.9PR-AUC
22
ProofNet
68.2PR-AUC
19
ProofNet (test)
97.9Pass@8
13
ProofNet (test)
44.09πFV
12
ProofNet (test)
44.62Pass@1
12
ProofNet
97.2Accuracy
11
ProofNet N = 186 (test)
98.4CH@100
11
ProofNet (val)
25.4Accuracy
11
PROOFNET (186 problems)
24.73Pass@8
9
ProofNet (all)
25.3Accuracy
7
ProofNet (test)
95.6Accuracy
6
ProofNet (val)
9.04Pass Rate
6
ProofNet
91.6Compiler Success Rate
5
ProofNet
131TS
4
ProofNet
90.7ASR
4
ProofNet N=186 (test)
0.785Pass@64
4
ProofNet
27.9PPL
3
ProofNet
3.67Objects
1