Explanation self-consistency on ECQA (test)
71.11AccuracyPSCB
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| PSCBModel=LLaMA3.1-8B, Attribution Method=LIME2025.06 | 71.11 | 0.077 | 0.0818 | 0.0867 | 0.0507 | 0.1847 | 0.3176 | |
| PSCBModel=LLaMA3.1-8B, Attribution Method=LIG2025.06 | 66.51 | 0.0136 | 0.0167 | 0.0198 | 0.3379 | 0.417 | 0.4911 | |
| PSCBModel=LLaMA3.2-3B, Attribution Method=LIME2025.06 | 65.85 | 0.013 | 0.0165 | 0.0199 | 0.0975 | 0.2228 | 0.3464 | |
| PSCBModel=LLaMA3.2-3B, Attribution Method=LIG2025.06 | 64.83 | 0.0182 | 0.0225 | 0.0266 | 0.3055 | 0.3872 | 0.4654 |