Data Attribution Fidelity on WikiText
0.842Spearman ρ (AdamW Influence)AdamW-influence
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AdamW-influenceModel Architecture=GPT-2, LR=1e-52026.05 | 0.842 | — | 75 | |
| AdamW-influenceModel Architecture=GPT-2, LR=5e-52026.05 | 0.825 | — | 91 | |
| AdamW-influenceModel Architecture=GPT-2, LR=1e-42026.05 | 0.734 | — | 97 | |
| SGD-influenceModel Architecture=GPT-2, LR=1e-42026.05 | — | 0.372 | — | |
| SGD-influenceModel Architecture=GPT-2, LR=5e-52026.05 | — | 0.432 | — | |
| SGD-influenceModel Architecture=GPT-2, LR=1e-52026.05 | — | 0.48 | — |