Diagonal Fisher Information Matrix Estimation on DBpedia
22RelMAEHutchinson's FIM estimator
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Hutchinson's FIM estimatorBackbone=RoBERTa-base2025.05 | 22 | 1 | |
| Diagonal Gauss-Newton FIM estimatorBackbone=RoBERTa-base2025.05 | 25 | 1 | |
| Empirical FIMBackbone=RoBERTa-base2025.05 | 59 | 1 | |
| Low-rank(2) FIM estimatorBackbone=RoBERTa-base2025.05 | 72 | 0.93 | |
| Low-rank FIM estimatorBackbone=RoBERTa-base2025.05 | 80 | 0.93 |