List your company

Summarization Meta-evaluation on SummEval (test)

0.668Coherence (Pearson r)HD-EVAL-NN
0.119920.262210.40450.54679Feb 24, 2024

Evaluation results

MethodLinks
HD-EVAL-NNtraining_data_percentage=50%2024.020.6680.6570.6040.4510.580.4350.6190.5990.6170.535
HD-EVAL-NNtraining_data_percentage=25%2024.020.6550.6440.5730.4570.5620.4370.6010.5770.5980.529
GPT-4 EVAL2024.020.5470.5420.5070.4580.4790.460.6090.5920.5380.513
UNIEVAL2024.020.5450.5880.6020.4390.6010.460.4640.4780.5530.491
BARTSCORE2024.020.4230.4030.350.3170.3030.250.4150.3860.3730.339
BERTSCORE2024.020.3020.2850.0930.0710.1740.1190.3890.3720.2390.212
CTC2024.020.220.1810.5310.4070.4940.3050.2590.1270.3760.255
PRISM2024.020.1880.1840.0670.0390.0740.0530.290.290.1540.141
ROUGE-12024.020.1780.1680.0370.0280.0450.0090.2880.2910.1370.124
ROUGE-22024.020.1430.1520.0250.0110.029-0.0060.2090.240.1010.099
ROUGE-L2024.020.1410.1340.0260.0150.0520.0220.2620.2640.120.109