Counterfactual Subset-Utility Evaluation on BasicSkills Logical Reasoning
0.457Spearman Correlation ($
ho$)GRASP
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GRASPEvaluation Protocol=Linear Datamodeling Score (LDS), Model Architecture=50M-parameter causal decoder-only Transformer2026.06 | 0.457 | 98 | |
| TracInEvaluation Protocol=Linear Datamodeling Score (LDS), Model Architecture=50M-parameter causal decoder-only Transformer2026.06 | 0.22 | 70.3 | |
| TRAKEvaluation Protocol=Linear Datamodeling Score (LDS), Model Architecture=50M-parameter causal decoder-only Transformer2026.06 | 0.167 | 67.2 | |
| BM25Evaluation Protocol=Linear Datamodeling Score (LDS), Model Architecture=50M-parameter causal decoder-only Transformer2026.06 | 0.029 | 50 |