Code Generation on MultiPL-E Java (Pass@1)
42.07Pass@1MBPP + Fourier (unmerged)
Evaluation results
| Method | Links | |
|---|---|---|
| MBPP + Fourier (unmerged)Objective=Cross-Lingual Transfer, Description=Fourier (unmerged), Fine-tuning=MBPP + Fourier, Configuration=MBPP + Fourier (unmerged)2026.04 | 42.07 | |
| Code Llama-7B (vanilla)Objective=Cross-Lingual Transfer, Description=Java baseline, Fine-tuning=None, Configuration=Code Llama-7B (vanilla)2026.04 | 33.25 | |
| MBPP + Fourier (merged)Objective=Cross-Lingual Transfer, Description=Fourier (merged), Fine-tuning=MBPP + Fourier, Configuration=MBPP + Fourier (merged)2026.04 | 32.93 | |
| MBPP fine-tuned (merged)Objective=Cross-Lingual Transfer, Description=Cross-lingual after MBPP, Fine-tuning=MBPP, Configuration=MBPP fine-tuned (merged)2026.04 | 31.46 | |
| CodeSearchNet fine-tuned (merged)Objective=Cross-Lingual Transfer, Description=Cross-lingual after CodeSearchNet, Fine-tuning=CodeSearchNet (2000 samples), Configuration=CodeSearchNet fine-tuned (merged)2026.04 | 31.1 | |
| APPS fine-tuned (merged)Objective=Cross-Lingual Transfer, Description=Cross-lingual after APPS, Fine-tuning=APPS, Configuration=APPS fine-tuned (merged)2026.04 | 27.37 |