Faithfulness Evaluation on SQuAD
62.7AUPCMExGen C-LIME
Evaluation results
| Method | Links | |
|---|---|---|
| MExGen C-LIMEModel=Flan-T5-Large, Scalarizer=Log Probability2024.03 | 62.7 | |
| MExGen L-SHAPModel=Flan-T5-Large, Scalarizer=Log Probability2024.03 | 61.1 | |
| MExGen LOOModel=Flan-T5-Large, Scalarizer=Log Probability2024.03 | 60.2 | |
| P-SHAPModel=Flan-T5-Large, Scalarizer=Log Probability2024.03 | 58.8 | |
| MExGen L-SHAPModel=Llama-3-8B-Instruct, Scalarizer=SUMM2024.03 | 57 | |
| MExGen C-LIMEModel=Llama-3-8B-Instruct, Scalarizer=SUMM2024.03 | 56.4 | |
| MExGen LOOModel=Llama-3-8B-Instruct, Scalarizer=SUMM2024.03 | 54.9 | |
| P-SHAPModel=Llama-3-8B-Instruct, Scalarizer=SUMM2024.03 | 38.5 |