Code Reasoning (Input Prediction) on CruxEval-I
35.7CX-I50% CodeEnhance + 50% Nemotron-RW
Evaluation results
| Method | Links | |
|---|---|---|
| 50% CodeEnhance + 50% Nemotron-RWTokens (B)=102026.06 | 35.7 | |
| CodeEnhanceTokens (B)=102026.06 | 35.3 | |
| CodeEnhance+Nemotron-RW+SwallowCodeTokens (B)=102026.06 | 34.6 | |
| 90% CodeEnhance+CodeQA + 10% RawTokens (B)=102026.06 | 34.5 | |
| CodeEnhance-gemma-4bTokens (B)=102026.06 | 33.8 | |
| CodeEnhance+CodeQATokens (B)=102026.06 | 33.6 | |
| 95% CodeEnhance+CodeQA + 5% RawTokens (B)=102026.06 | 33.6 | |
| Nemotron-RWTokens (B)=102026.06 | 32.3 | |
| SwallowCodeTokens (B)=102026.06 | 31.2 | |
| CodeEnhance-gemma-1bTokens (B)=102026.06 | 29.5 |