Counterfactual Generation on SST2 (test)
29SLFRPOLYJUICE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| POLYJUICEModel=GPT22025.01 | 29 | 258.32 | 71 | |
| BAEModel=BERT2025.01 | 47 | 367.06 | 9 | |
| ZEROCFModel=Qwen2.5-32B, Feature Importance Method=Gradient2025.01 | 70.5 | 205.06 | 48 | |
| ZEROCFModel=Qwen2.5-72B, Feature Importance Method=LIME2025.01 | 85 | 289.2 | 30 | |
| ZEROCFModel=Qwen2.5-72B, Feature Importance Method=SHAP2025.01 | 86.5 | 319.6 | 22 | |
| FIZLEModel=Qwen2.5-32B2025.01 | 86.8 | 167.51 | 66 | |
| ZEROCFModel=Qwen2.5-72B, Feature Importance Method=Gradient2025.01 | 88.5 | 263.47 | 34 | |
| FITCFModel=Qwen2.5-32B, Feature Importance Method=Gradient2025.01 | 89 | 214.25 | 51 | |
| FITCFModel=Qwen2.5-32B, Feature Importance Method=LIME2025.01 | 89.5 | 174.34 | 52 | |
| FITCFModel=Qwen2.5-32B, Feature Importance Method=SHAP2025.01 | 89.5 | 157.09 | 52 | |
| ZEROCFModel=Qwen2.5-32B, Feature Importance Method=LIME2025.01 | 90.5 | 576.59 | 62 | |
| FITCFModel=Qwen2.5-32B, Feature Importance Method=IG2025.01 | 90.5 | 221.64 | 49 | |
| ZEROCFModel=Qwen2.5-32B, Feature Importance Method=IG2025.01 | 91 | 222.57 | 64 | |
| FIZLEModel=Qwen2.5-72B2025.01 | 92 | 257.91 | 43 | |
| ZEROCFModel=Qwen2.5-72B, Feature Importance Method=IG2025.01 | 92 | 281.1 | 46 | |
| ZEROCFModel=Qwen2.5-32B, Feature Importance Method=SHAP2025.01 | 93 | 191 | 60 | |
| ZEROCFModel=Llama3-8B, Feature Importance Method=SHAP2025.01 | 94 | 204.76 | 46 | |
| FITCFModel=Qwen2.5-72B, Feature Importance Method=IG2025.01 | 95 | 207.55 | 39 | |
| FIZLEModel=Llama3-8B2025.01 | 95.5 | 202.22 | 52 | |
| FITCFModel=Qwen2.5-72B, Feature Importance Method=Gradient2025.01 | 96 | 595.71 | 38 | |
| FITCFModel=Qwen2.5-72B, Feature Importance Method=LIME2025.01 | 96.5 | 240.94 | 41 | |
| FITCFModel=Qwen2.5-72B, Feature Importance Method=SHAP2025.01 | 96.5 | 590.94 | 39 | |
| ZEROCFModel=Llama3-8B, Feature Importance Method=LIME2025.01 | 97 | 264.91 | 42 | |
| ZEROCFModel=Llama3-8B, Feature Importance Method=Gradient2025.01 | 97.5 | 239.15 | 46 | |
| ZEROCFModel=Llama3-8B, Feature Importance Method=IG2025.01 | 99.5 | 222.51 | 42 | |
| FITCFModel=Llama3-8B, Feature Importance Method=Gradient2025.01 | 99.8 | 159.57 | 47 | |
| FITCFModel=Llama3-8B, Feature Importance Method=IG2025.01 | 100 | 161.88 | 48 | |
| FITCFModel=Llama3-8B, Feature Importance Method=LIME2025.01 | 100 | 151.22 | 48 | |
| FITCFModel=Llama3-8B, Feature Importance Method=SHAP2025.01 | 100 | 157.36 | 49 |