ProofWriter
Benchmarks
TaskDatasetSOTA resultTrendResults
ProofWriter (test)
92.32Accuracy
57
ProofWriter
98.4Accuracy
44
ProofWriter
75Accuracy
43
ProofWriter
99.7Accuracy
24
ProofWriter
99.67End-to-end Accuracy
21
ProofWriter OWA (3-hop)
76.6Accuracy
20
ProofWriter CWA 3-hop
73.8Accuracy
20
ProofWriter
97.4Pass@1
18
PROOFWRITER
0.339Somers' D
15
ProofWriter
92Initial Score
15
ProofWriter
65Accuracy
14
ProofWriter (held-out)
0.548Performance
14
ProofWriter (test)
100ExcRate
12
ProofWriter depth-5 OWA setting
71.95Accuracy (ProofWriter d5 OWA)
8
ProofWriter
92.1Calibrated Accuracy
8
ProofWriter
81.3Accuracy
7
ProofWriter
92.2Acc
6
ProofWriter
0.531Score
3
ProofWriter
73.23Pass@1
2
ProofWriter 600 records (test)
—Exc. Rate
0