PyPI
Benchmarks
TaskDatasetSOTA resultTrendResults
PyPI dataset (51 Python applications)
100Success Rate
54
PyPI (test)
96.1Precision
17
PyPI (Extremely Large ≥700KB)
96.33Accuracy
12
PyPI (Extremely Small ≤1.57KB)
95.96Accuracy
12
PyPI Extensive Imports (test)
95Accuracy
12
PyPI Minimal Imports (test)
96.6Accuracy
12
PyPI
99.5Accuracy
8
PyPI NPM-trained (test)
75.1Precision
6
PyPI Top100
93.5Accuracy
2
PyPI Linux x86_64 2025
—Primary metric
0