Faithfulness Measurement on Alpaca benchmark leaderboard · SOTA2 Research

Faithfulness Measurement on Alpaca

0.601BLEURandom

Evaluation Results

Method	Links
Random2024.05		0.601	0.527	0.533	0.522	0.825	0.842	0.134
Random2024.05		0.587	0.541	0.552	0.535	0.786	0.891	0.079
Attention2024.05		0.547	0.447	0.46	0.448	0.721	0.791	0.17
Integrated-Gradient2024.05		0.541	0.424	0.435	0.424	0.725	0.726	0.242
Integrated-Gradient2024.05		0.541	0.495	0.503	0.488	0.744	0.835	0.135
Last-Attention2024.05		0.533	0.423	0.452	0.432	0.672	0.77	0.202
Captum2024.05		0.515	0.409	0.421	0.409	0.68	0.602	0.417
Attention2024.05		0.486	0.447	0.469	0.441	0.683	0.831	0.14
JoPA2024.05		0.484	0.388	0.386	0.379	0.642	0.549	0.504
Last-Attention2024.05		0.475	0.423	0.436	0.415	0.672	0.84	0.113
Captum2024.05		0.466	0.435	0.427	0.418	0.649	0.654	0.347
JoPA2024.05		0.433	0.395	0.39	0.377	0.639	0.589	0.459