Persona-based medical summarization on WebMD (test) benchmark leaderboard · SOTA2 Research

Persona-based medical summarization on WebMD (test)

0.537ROUGE-1L-F-13b (Llama2-13b Fine-tuned)

Evaluation Results

Method	Links
L-F-13b (Llama2-13b Fine-tuned)2024.06		0.537	0.243	0.338	0.383	0.184	0.874	0.853	0.863
L-F-7b (Llama2-7b Fine-tuned)2024.06		0.459	0.172	0.252	0.326	0.125	0.836	0.826	0.831
T5-FT (T5-Large)2024.06		0.426	0.156	0.237	0.302	0.114	0.842	0.807	0.824
FT5-FT (Flan-T5-Large)2024.06		0.412	0.155	0.233	0.29	0.112	0.839	0.799	0.819
LED-L (Longformer-Large)2024.06		0.398	0.123	0.256	0.253	0.093	0.825	0.787	0.806
LED-B (Longformer-Base)2024.06		0.333	0.093	0.174	0.173	0.033	0.807	0.767	0.786
Pegasus2024.06		0.278	0.083	0.162	0.143	0.02	0.807	0.75	0.778
L-V-70b (Llama2-70b Vanilla)2024.06		0.251	0.072	0.137	0.162	0.037	0.657	0.646	0.651
L-V-13b (Llama2-13b Vanilla)2024.06		0.241	0.073	0.143	0.115	0.011	0.808	0.735	0.77
BART-large2024.06		0.236	0.081	0.15	0.113	0.008	0.838	0.749	0.791
Falcon 7b-instruction2024.06		0.233	0.05	0.128	0.124	0.013	0.786	0.732	0.758
L-V-7b (Llama2-7b Vanilla)2024.06		0.142	0.04	0.085	0.067	0.006	0.72	0.657	0.687