Data Attribution on WikiText-2 (held-out query)
0.979Spearman (LDS)MAGIC
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MAGICBackbone=GPT-2 (124M), Dataset=WikiText-2, Method Category=unrolled differentiation, Number of random subsets (N)=1002026.06 | 0.979 | 0.978 | |
| EK-FACBackbone=GPT-2 (124M), Dataset=WikiText-2, Gradient Projection=none, Number of random subsets (N)=1002026.06 | 0.318 | 0.284 | |
| TrackStarBackbone=GPT-2 (124M), Dataset=WikiText-2, Per-module projected gradient size=1024, Number of random subsets (N)=1002026.06 | 0.164 | 0.273 |