Code Generation on CodeX
48.96CodeX ScoreMADS3B
Evaluation Results
| Method | Links | |
|---|---|---|
| MADS3BBase Model=Llama-3-8B, Training Data Scale=15%, Instructor Model=Llama-3.2-3B-Instruct2026.05 | 48.96 | |
| InsTagBase Model=Llama-3-8B, Training Data Scale=15%2026.05 | 48.35 | |
| MADS8BBase Model=Llama-3-8B, Training Data Scale=15%, Instructor Model=Llama-3.1-8B-Instruct2026.05 | 48.23 | |
| ClusterClipBase Model=Llama-3-8B, Training Data Scale=15%2026.05 | 47.86 | |
| FullBase Model=Llama-3-8B, Training Data Scale=100%2026.05 | 46.28 | |
| DEITABase Model=Llama-3-8B, Training Data Scale=15%2026.05 | 45.98 | |
| SelectITBase Model=Llama-3-8B, Training Data Scale=15%2026.05 | 45.43 | |
| MoDSBase Model=Llama-3-8B, Training Data Scale=15%2026.05 | 45 | |
| NUGGETSBase Model=Llama-3-8B, Training Data Scale=15%2026.05 | 43.9 | |
| IFDBase Model=Llama-3-8B, Training Data Scale=15%2026.05 | 42.99 | |
| MADS3BBase Model=Llama-2-7B, Training Data Scale=15%, Instructor Model=Llama-3.2-3B-Instruct2026.05 | 18.05 | |
| MADS8BBase Model=Llama-2-7B, Training Data Scale=15%, Instructor Model=Llama-3.1-8B-Instruct2026.05 | 17.44 | |
| NUGGETSBase Model=Llama-2-7B, Training Data Scale=15%2026.05 | 17.07 | |
| DEITABase Model=Llama-2-7B, Training Data Scale=15%2026.05 | 17.01 | |
| MoDSBase Model=Llama-2-7B, Training Data Scale=15%2026.05 | 16.77 | |
| SelectITBase Model=Llama-2-7B, Training Data Scale=15%2026.05 | 16.52 | |
| IFDBase Model=Llama-2-7B, Training Data Scale=15%2026.05 | 15.85 | |
| FullBase Model=Llama-2-7B, Training Data Scale=100%2026.05 | 15.61 | |
| InsTagBase Model=Llama-2-7B, Training Data Scale=15%2026.05 | 15.06 | |
| ClusterClipBase Model=Llama-2-7B, Training Data Scale=15%2026.05 | 14.82 |