Instruction Tuning on Magicoder HumanEval
50.84StabilityFLOW
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FLOWData %=100, Param %=100, E2E time=24.1h2026.05 | 50.84 | 42.28 | 46.56 | |
| TALRData %=100, Param %=100, E2E time=25.6h2026.05 | 50.7 | 44.18 | 47.44 | |
| DualSFTData %=10, Param %=5, E2E time=7.4h2026.05 | 50.54 | 43.67 | 47.1 | |
| DualSFT-DataData %=10, Param %=100, E2E time=8.9h2026.05 | 50.23 | 44.05 | 47.14 | |
| DualSFT-ParamData %=100, Param %=5, E2E time=13.4h2026.05 | 49.75 | 44.52 | 47.14 | |
| FAPMData %=100, Param %=100, E2E time=22.8h2026.05 | 49.61 | 40.99 | 45.3 | |
| NanoAdamData %=100, Param %=5, E2E time=11.5h2026.05 | 48.61 | 43.54 | 46.08 |