Diagonal Fisher Information Matrix Estimation on MNLI
0.11RelMAELow-rank FIM estimator
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Low-rank FIM estimatorBackbone=RoBERTa-base2025.05 | 0.11 | 0.96 | |
| Low-rank(2) FIM estimatorBackbone=RoBERTa-base2025.05 | 0.12 | 0.95 | |
| Hutchinson's FIM estimatorBackbone=RoBERTa-base2025.05 | 0.16 | 1 | |
| Diagonal Gauss-Newton FIM estimatorBackbone=RoBERTa-base2025.05 | 8.36 | 0.97 | |
| Empirical FIMBackbone=RoBERTa-base2025.05 | 53.9 | 1 |