Counterfactual Generation on SNLI Hypothesis
83LFRiFlip-Conf
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| iFlip-ConfExplained Model=RoBERTa-base, Generator Model=LLaMA 3.3-70B, Feedback Type=Confidence2026.01 | 83 | 79.9 | 47.43 | |
| iFlipBackbone LLM=OLMo2-7B, Feedback Type=Confidence2026.01 | 82.6 | 87 | 40.65 | |
| FIZLEExplained Model=RoBERTa-base, Generator Model=LLaMA 3.3-70B2026.01 | 82.1 | 92.9 | 42.39 | |
| iFlip-NLExplained Model=RoBERTa-base, Generator Model=LLaMA 3.3-70B, Feedback Type=Natural Language2026.01 | 81.5 | 81.5 | 52.91 | |
| iFlipBackbone LLM=OLMo2-7B, Feedback Type=AttnLRP2026.01 | 81 | 86.9 | 40.31 | |
| iFlip-SHAPExplained Model=RoBERTa-base, Generator Model=LLaMA 3.3-70B, Feedback Type=Feature Attribution2026.01 | 80 | 79.5 | 44.69 | |
| iFlipBackbone LLM=OLMo2-7B, Feedback Type=Grad×Input2026.01 | 78.2 | 87.1 | 41.81 | |
| iFlipBackbone LLM=OLMo2-7B, Feedback Type=Natural Language2026.01 | 77 | 90.1 | 43.81 | |
| iFlipBackbone LLM=OLMo2-7B, Feedback Type=SHAP2026.01 | 76 | 86.7 | 42.39 | |
| iFlipBackbone LLM=Qwen3-32B, Feedback Type=Natural Language2026.01 | 75.4 | 90.6 | 47.2 | |
| Causal What-IfsExplained Model=RoBERTa-base, Generator Model=LLaMA 3.3-70B2026.01 | 74 | 89.2 | 43.63 | |
| iFlipBackbone LLM=OLMo2-7B, Feedback Type=LIME2026.01 | 73.6 | 87.5 | 41.02 | |
| CGGExplained Model=RoBERTa-base, Generator Model=LLaMA 3.3-70B2026.01 | 68 | 94.4 | 54.23 | |
| iFlipBackbone LLM=LLaMA3.3-70B, Feedback Type=Natural Language2026.01 | 68 | 86.1 | 69.45 | |
| BAEExplained Model=RoBERTa-base2026.01 | 66.5 | 91.4 | 92.1 | |
| iFlipBackbone LLM=LLaMA3.3-70B, Feedback Type=Confidence2026.01 | 64.2 | 84.3 | 43.88 | |
| iFlipBackbone LLM=Qwen3-32B, Feedback Type=AttnLRP2026.01 | 61 | 86.7 | 44.77 | |
| iFlipBackbone LLM=LLaMA3.3-70B, Feedback Type=LIME2026.01 | 60.8 | 82.5 | 42.91 | |
| iFlipBackbone LLM=LLaMA3.3-70B, Feedback Type=SHAP2026.01 | 60.6 | 82.8 | 41.09 | |
| iFlipBackbone LLM=LLaMA3.3-70B, Feedback Type=Grad×Input2026.01 | 60.3 | 82.5 | 39.59 | |
| iFlipBackbone LLM=LLaMA3.3-70B, Feedback Type=AttnLRP2026.01 | 60.2 | 82.2 | 39.92 | |
| iFlipBackbone LLM=Qwen3-32B, Feedback Type=SHAP2026.01 | 58.6 | 86.6 | 45.04 | |
| iFlipBackbone LLM=Qwen3-32B, Feedback Type=LIME2026.01 | 57 | 87 | 44.22 | |
| iFlipBackbone LLM=Qwen3-32B, Feedback Type=Confidence2026.01 | 56.2 | 87.1 | 47.03 | |
| iFlipBackbone LLM=Qwen3-32B, Feedback Type=Grad×Input2026.01 | 54.2 | 86.5 | 45.6 | |
| FIZLEBackbone LLM=LLaMA3.3-70B2026.01 | 53.4 | 92.9 | 42.39 | |
| FIZLEBackbone LLM=Qwen3-32B2026.01 | 52.4 | 91.8 | 35.97 | |
| Causal What-IfsBackbone LLM=Qwen3-32B2026.01 | 51.8 | 92 | 34.18 | |
| Causal What-IfsBackbone LLM=OLMo2-7B2026.01 | 48.7 | 91.1 | 35.56 | |
| Causal What-IfsBackbone LLM=LLaMA3.3-70B2026.01 | 42 | 90.4 | 41.29 | |
| FIZLEBackbone LLM=OLMo2-7B2026.01 | 40.4 | 88.2 | 74.15 | |
| Polyjuice2026.01 | 35 | 73.3 | 114.59 | |
| CGGBackbone LLM=Qwen3-32B2026.01 | 28.3 | 93.8 | 47.94 | |
| CGGBackbone LLM=LLaMA3.3-70B2026.01 | 27.1 | 93.7 | 46.58 | |
| PolyjuiceExplained Model=RoBERTa-base2026.01 | 26 | 73.3 | 114.59 | |
| CGGBackbone LLM=OLMo2-7B2026.01 | 25.3 | 94.8 | 53.92 | |
| BAE2026.01 | 11.5 | 97.9 | 81 |