Parameter Estimation on Synthetic MoE regression problem data-driven initialization
0.014MSEInc. MM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Inc. MMinitialization=data-driven2026.01 | 0.014 | 0.228 | 0.009 | |
| Adam Winitialization=data-driven2026.01 | 0.192 | 1.816 | 0.035 | |
| Sophiainitialization=data-driven2026.01 | 0.272 | 1.633 | 0.042 | |
| RMSPropinitialization=data-driven2026.01 | 0.322 | 0.545 | 0.042 | |
| SGDinitialization=data-driven2026.01 | 0.415 | 2.23 | 0.05 | |
| Adaminitialization=data-driven2026.01 | 0.824 | 1.272 | 0.061 |