Directional Influence Estimation on Counterfactual Influence Traces (ΔNLL > 0.05 threshold, val)
39.3A-to-B Ratecounterfactual influence test
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| counterfactual influence testCheckpoint=Checkpoint 3, Substantive threshold (ΔNLL)=> 0.05, Number of random seeds=5, Sampled traces per checkpoint-seed pair=5002026.05 | 39.3 | 0.048 | 6.9 | 0.018 | |
| counterfactual influence testCheckpoint=Checkpoint 2, Substantive threshold (ΔNLL)=> 0.05, Number of random seeds=5, Sampled traces per checkpoint-seed pair=5002026.05 | 39 | 0.048 | 7 | 0.017 | |
| counterfactual influence testCheckpoint=Checkpoint 1, Substantive threshold (ΔNLL)=> 0.05, Number of random seeds=5, Sampled traces per checkpoint-seed pair=5002026.05 | 23.6 | 0.034 | 2.3 | 0.011 |