Training Data Attribution on Nanochat Unseen (test)
0.1792LDS CorrelationSTRIDE
Evaluation Results
| Method | Links | |
|---|---|---|
| STRIDEModel Capacity=537M, Runtime (h)=9.9, Peak GPU (GB)=8.412026.06 | 0.1792 | |
| STRIDEModel Capacity=1.38B, Runtime (h)=9.9, Peak GPU (GB)=8.412026.06 | 0.1671 | |
| STRIDEModel Capacity=897M, Runtime (h)=9.9, Peak GPU (GB)=8.412026.06 | 0.1598 | |
| AirRepModel Capacity=537M, Runtime (h)=116.1, Peak GPU (GB)=6.022026.06 | 0.1592 | |
| STRIDEModel Capacity=286M, Runtime (h)=9.9, Peak GPU (GB)=8.412026.06 | 0.1581 | |
| AirRepModel Capacity=897M, Runtime (h)=116.1, Peak GPU (GB)=6.022026.06 | 0.1438 | |
| AirRepModel Capacity=286M, Runtime (h)=116.1, Peak GPU (GB)=6.022026.06 | 0.1406 | |
| GTEModel Capacity=1.38B, Runtime (h)=2.99, Peak GPU (GB)=7.022026.06 | 0.1284 | |
| LoGRAModel Capacity=537M, Runtime (h)=52.3, Peak GPU (GB)=17.742026.06 | 0.1272 | |
| AirRep (PT)Model Capacity=537M, Runtime (h)=105.0, Peak GPU (GB)=2.102026.06 | 0.1259 | |
| LoGRAModel Capacity=1.38B, Runtime (h)=52.3, Peak GPU (GB)=17.742026.06 | 0.1139 | |
| LoGRAModel Capacity=897M, Runtime (h)=52.3, Peak GPU (GB)=17.742026.06 | 0.1138 | |
| GTEModel Capacity=537M, Runtime (h)=2.99, Peak GPU (GB)=7.022026.06 | 0.1132 | |
| LoGRAModel Capacity=286M, Runtime (h)=52.3, Peak GPU (GB)=17.742026.06 | 0.1126 | |
| AirRep (PT)Model Capacity=897M, Runtime (h)=105.0, Peak GPU (GB)=2.102026.06 | 0.1112 | |
| AirRep (PT)Model Capacity=286M, Runtime (h)=105.0, Peak GPU (GB)=2.102026.06 | 0.1108 | |
| GTEModel Capacity=897M, Runtime (h)=2.99, Peak GPU (GB)=7.022026.06 | 0.1028 | |
| GTEModel Capacity=286M, Runtime (h)=2.99, Peak GPU (GB)=7.022026.06 | 0.1006 | |
| TF-IDFModel Capacity=537M, Runtime (h)=8.28, Peak GPU (GB)=0.002026.06 | 0.0951 | |
| TF-IDFModel Capacity=1.38B, Runtime (h)=8.28, Peak GPU (GB)=0.002026.06 | 0.0893 | |
| TF-IDFModel Capacity=897M, Runtime (h)=8.28, Peak GPU (GB)=0.002026.06 | 0.0864 | |
| TF-IDFModel Capacity=286M, Runtime (h)=8.28, Peak GPU (GB)=0.002026.06 | 0.0842 | |
| RDSModel Capacity=537M, Runtime (h)=24.05, Peak GPU (GB)=11.622026.06 | 0.0748 | |
| RDSModel Capacity=1.38B, Runtime (h)=24.05, Peak GPU (GB)=11.622026.06 | 0.0742 | |
| RDSModel Capacity=897M, Runtime (h)=24.05, Peak GPU (GB)=11.622026.06 | 0.0695 | |
| RDSModel Capacity=286M, Runtime (h)=24.05, Peak GPU (GB)=11.622026.06 | 0.0691 |