Explanation self-consistency on ARC-C (test)
77.57AccuracyPSCB
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| PSCBModel=LLaMA3.1-8B, Attribution Method=LIME2025.06 | 77.57 | 15.09 | 16.07 | 17.08 | 1.82 | 11.48 | 24.73 | |
| PSCBModel=LLaMA3.1-8B, Attribution Method=LIG2025.06 | 71.12 | 1.39 | 1.67 | 1.94 | 37.07 | 44.87 | 52.11 | |
| PSCBModel=LLaMA3.2-3B, Attribution Method=LIME2025.06 | 68.7 | 7.67 | 8.29 | 8.93 | 5.94 | 18.44 | 30.89 | |
| PSCBModel=LLaMA3.2-3B, Attribution Method=LIG2025.06 | 64.9 | 1.49 | 1.9 | 2.29 | 33.22 | 41.43 | 49.12 |