CODEPARROT
Benchmarks
TaskDatasetSOTA resultTrendResults
CODEPARROT
3.36Perplexity
19
CodeParrot
49.5ROUGE-1
15
CodeParrot 16K
2.25Perplexity
8
CodeParrot 4K
2.33Perplexity
8
CodeParrot 100K
2.36Perplexity
6
CodeParrot 32K
2.23Perplexity
6
codeparrot sequence length 256 (val)
1.222Bits per Character (BPC)
3
codeparrot-clean In-Domain (val)
99.47Reconstruction Accuracy (TRA)
1