NLP4LP
Benchmarks
TaskDatasetSOTA resultTrendResults
NLP4LP
97.2Accuracy (pass@1)
45
NLP4LP
89.02SA Score
34
NLP4LP
18.18Error Rate (ER)
19
NLP4LP
94Accuracy
14
NLP4LP (test)
90.5Success Rate
10
NLP4LP Easy
85.7Accuracy
9
NLP4LP (n=65)
76.92Execution Accuracy
9
NLP4LP Hard
75.4Accuracy
8
NLP4LP 264 samples (test)
89.02Success Rate
8
NLP4LP
83.8Solution Accuracy (SA)
7
NLP4LP (Standard)
81.4Accuracy
3
NLP4LP Curated (LLMOPT)
95.7Accuracy
2