Stability on General (MMLU, BBH, TyDiQA, BoolQ, PIQA, GSM8K)
55.75General ScoreFGGM
Evaluation Results
| Method | Links | |
|---|---|---|
| FGGMAccess OriData=false, Model Scale=1.5B, Input-dimension Aggregation=true2026.01 | 55.75 | |
| MIGUAccess OriData=false, Model Scale=1.5B2026.01 | 55.21 | |
| FGGM (w/o IA)Access OriData=false, Model Scale=1.5B, Input-dimension Aggregation=false2026.01 | 54.85 | |
| REPAccess OriData=true, Model Scale=1.5B2026.01 | 53.66 | |
| FGGM (Apply OA)Access OriData=false, Model Scale=1.5B, Output-dimension Aggregation=true2026.01 | 53.16 | |
| ORIAccess OriData=N/A, Model Scale=1.5B2026.01 | 52.45 | |
| SFTAccess OriData=false, Model Scale=1.5B2026.01 | 50.89 | |
| EWCAccess OriData=true, Model Scale=1.5B2026.01 | 50.81 | |
| LORAAccess OriData=false, Model Scale=1.5B2026.01 | 49.48 |