Diagonal Fisher Information Matrix Estimation on SST-2
0.05RelMAELow-rank FIM estimator
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Low-rank FIM estimatorBackbone=RoBERTa-base2025.05 | 0.05 | 0.96 | |
| Low-rank(2) FIM estimatorBackbone=RoBERTa-base2025.05 | 0.05 | 1 | |
| Hutchinson's FIM estimatorBackbone=RoBERTa-base2025.05 | 0.18 | 1.07 | |
| Empirical FIMBackbone=RoBERTa-base2025.05 | 1.15 | 1 | |
| Diagonal Gauss-Newton FIM estimatorBackbone=RoBERTa-base2025.05 | 341 | 1.07 |