Ranking correlation with full dataset evaluation on Adv. NLI R1
0.59Kendall CorrelationILDAE
Evaluation Results
| Method | Links | |
|---|---|---|
| ILDAEPercentage of instances=20%2022.03 | 0.59 | |
| ILDAEPercentage of instances=10%2022.03 | 0.47 | |
| ILDAEPercentage of instances=5%2022.03 | 0.3 | |
| ILDAEPercentage of instances=2%2022.03 | 0.2 | |
| ILDAEPercentage of instances=0.5%2022.03 | 0.17 | |
| HeuristicPercentage of instances=1%2022.03 | 0.09 | |
| ILDAEPercentage of instances=1%2022.03 | 0.08 | |
| RandomPercentage of instances=1%2022.03 | 0.02 | |
| RandomPercentage of instances=0.5%2022.03 | 0 | |
| HeuristicPercentage of instances=0.5%2022.03 | -0.07 |