Code Generation on CodeAlpaca (Score)
33.2ScoreEPI
Evaluation results
| Method | Links | |
|---|---|---|
| EPIBase Model=Gemma-2-9B, Number of runs=32026.04 | 33.2 | |
| Static IsolationBase Model=Gemma-2-9B, Number of runs=32026.04 | 31.5 | |
| EPIBase Model=LLaMA-3-8B, Number of runs=32026.04 | 31.2 | |
| Full SFTBase Model=Gemma-2-9B, Number of runs=32026.04 | 30.1 | |
| Static IsolationBase Model=LLaMA-3-8B, Number of runs=32026.04 | 29.4 | |
| Full SFTBase Model=LLaMA-3-8B, Number of runs=32026.04 | 28.3 | |
| Base modelBackbone=Qwen2.5-0.5B-Instruct2026.05 | 0.683 | |
| SPD-QABackbone=Qwen2.5-0.5B-Instruct, Calibration Domain=QA2026.05 | 0.68 | |
| SSD-QABackbone=Qwen2.5-0.5B-Instruct, Calibration Domain=QA2026.05 | 0.676 |