Counterfactual Generation on AG News
0.915LFRiFlip-NL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| iFlip-NLExplained Model=RoBERTa-base, Generator Model=LLaMA 3.3-70B, Feedback Type=Natural Language2026.01 | 0.915 | 0.583 | 57.66 | |
| iFlipBackbone LLM=LLaMA3.3-70B, Feedback Type=Natural Language2026.01 | 0.9 | 0.527 | 63.86 | |
| iFlipBackbone LLM=LLaMA3.3-70B, Feedback Type=Confidence2026.01 | 0.89 | 0.468 | 44.38 | |
| iFlip-SHAPExplained Model=RoBERTa-base, Generator Model=LLaMA 3.3-70B, Feedback Type=Feature Attribution2026.01 | 0.885 | 0.542 | 57.69 | |
| iFlip-ConfExplained Model=RoBERTa-base, Generator Model=LLaMA 3.3-70B, Feedback Type=Confidence2026.01 | 0.88 | 0.575 | 55.55 | |
| iFlipBackbone LLM=LLaMA3.3-70B, Feedback Type=SHAP2026.01 | 0.86 | 0.481 | 46.07 | |
| iFlipBackbone LLM=LLaMA3.3-70B, Feedback Type=AttnLRP2026.01 | 0.858 | 0.477 | 45.78 | |
| iFlipBackbone LLM=LLaMA3.3-70B, Feedback Type=Grad×Input2026.01 | 0.852 | 0.479 | 46.12 | |
| iFlipBackbone LLM=LLaMA3.3-70B, Feedback Type=LIME2026.01 | 0.852 | 0.475 | 44.2 | |
| iFlipBackbone LLM=OLMo2-7B, Feedback Type=SHAP2026.01 | 0.802 | 0.488 | 42.95 | |
| iFlipBackbone LLM=OLMo2-7B, Feedback Type=Confidence2026.01 | 0.784 | 0.503 | 41.41 | |
| iFlipBackbone LLM=OLMo2-7B, Feedback Type=Grad×Input2026.01 | 0.773 | 0.498 | 50.32 | |
| iFlipBackbone LLM=OLMo2-7B, Feedback Type=AttnLRP2026.01 | 0.768 | 0.5 | 46.61 | |
| CGGExplained Model=RoBERTa-base, Generator Model=LLaMA 3.3-70B2026.01 | 0.748 | 0.542 | 130.31 | |
| iFlipBackbone LLM=Qwen3-32B, Feedback Type=AttnLRP2026.01 | 0.746 | 0.513 | 44.15 | |
| iFlipBackbone LLM=Qwen3-32B, Feedback Type=LIME2026.01 | 0.742 | 0.527 | 44.52 | |
| iFlipBackbone LLM=Qwen3-32B, Feedback Type=SHAP2026.01 | 0.736 | 0.519 | 44.02 | |
| iFlipBackbone LLM=OLMo2-7B, Feedback Type=Natural Language2026.01 | 0.735 | 0.515 | 44.73 | |
| iFlipBackbone LLM=Qwen3-32B, Feedback Type=Natural Language2026.01 | 0.732 | 0.536 | 49.68 | |
| iFlipBackbone LLM=OLMo2-7B, Feedback Type=LIME2026.01 | 0.73 | 0.504 | 44.32 | |
| iFlipBackbone LLM=Qwen3-32B, Feedback Type=Grad×Input2026.01 | 0.73 | 0.522 | 44.33 | |
| iFlipBackbone LLM=Qwen3-32B, Feedback Type=Confidence2026.01 | 0.726 | 0.521 | 41.59 | |
| Causal What-IfsExplained Model=RoBERTa-base, Generator Model=LLaMA 3.3-70B2026.01 | 0.656 | 0.442 | 46.18 | |
| Causal What-IfsBackbone LLM=LLaMA3.3-70B2026.01 | 0.636 | 0.461 | 43.56 | |
| CGGBackbone LLM=LLaMA3.3-70B2026.01 | 0.526 | 0.694 | 122.4 | |
| CGGBackbone LLM=OLMo2-7B2026.01 | 0.51 | 0.38 | 208.56 | |
| BAEExplained Model=RoBERTa-base2026.01 | 0.443 | 0.813 | 246.61 | |
| Causal What-IfsBackbone LLM=Qwen3-32B2026.01 | 0.436 | 0.57 | 53.5 | |
| FIZLEBackbone LLM=LLaMA3.3-70B2026.01 | 0.416 | 0.707 | 56.59 | |
| Causal What-IfsBackbone LLM=OLMo2-7B2026.01 | 0.4 | 0.607 | 37.54 | |
| CGGBackbone LLM=Qwen3-32B2026.01 | 0.364 | 0.697 | 97.1 | |
| FIZLEExplained Model=RoBERTa-base, Generator Model=LLaMA 3.3-70B2026.01 | 0.345 | 0.707 | 56.59 | |
| FIZLEBackbone LLM=OLMo2-7B2026.01 | 0.308 | 0.584 | 77.38 | |
| BAE2026.01 | 0.227 | 0.764 | 295.96 | |
| PolyjuiceExplained Model=RoBERTa-base2026.01 | 0.165 | 0.744 | 93.22 | |
| FIZLEBackbone LLM=Qwen3-32B2026.01 | 0.164 | 0.864 | 61.46 | |
| Polyjuice2026.01 | 0.148 | 0.744 | 93.22 |