Code Generation on MBPP (Acc (%), Step)
64.59Accuracy (%)KLASS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| KLASSSampler=KLASS2025.11 | 64.59 | 111.24 | |
| Top-1Sampler=Top-12025.11 | 63.81 | 256 | |
| KL < 0.001Sampler=KL-based, KL_threshold=0.0012025.11 | 62.65 | 108.15 | |
| conf > 0.9Sampler=confidence-based, confidence_threshold=0.92025.11 | 57.59 | 72.49 | |
| Top-2Sampler=Top-22025.11 | 47.08 | 128 | |
| RandomSampler=Random2025.11 | 28.14 | 256 |