Diagonal Fisher Information Matrix Estimation on SpeechCommands
0.17RelMAEHutchinson's FIM estimator
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Hutchinson's FIM estimatorBackbone=Wav2Vec2-base2025.05 | 0.17 | 0.97 | |
| Low-rank(2) FIM estimatorBackbone=Wav2Vec2-base2025.05 | 0.22 | 0.91 | |
| Low-rank FIM estimatorBackbone=Wav2Vec2-base2025.05 | 0.39 | 0.89 | |
| Diagonal Gauss-Newton FIM estimatorBackbone=Wav2Vec2-base2025.05 | 7.4 | 0.97 | |
| Empirical FIMBackbone=Wav2Vec2-base2025.05 | 56.8 | 1 |