List your company

Opinion Summarization Evaluation on OPINSUMMEVAL

0.51Fluency (Spearman rho)OP-I-GPT-3.5
0.0420.16350.2850.4065Feb 18, 2024

Evaluation results

MethodLinks
OP-I-GPT-3.5backbone=GPT-3.5, prompt_type=OP-I-PROMPT2024.020.510.460.360.320.330.290.430.39
CHATGPT-3.5backbone=GPT-3.52024.020.470.420.280.250.340.30.370.33
G-EVAL-MISTRALbackbone=Mistral-7B2024.020.460.410.410.380.360.320.490.45
OP-I-MISTRALbackbone=Mistral-7B, prompt_type=OP-I-PROMPT2024.020.460.410.370.350.380.340.490.45
BARTSCORE2024.020.420.330.350.290.280.220.410.34
G-EVAL-3.5backbone=GPT-3.52024.020.410.360.290.260.270.230.380.34
BERTSCORE2024.020.380.30.20.170.20.160.080.06
OP-MISTRALbackbone=Mistral-7B, prompt_type=OP-PROMPTS2024.020.350.330.450.410.340.30.450.41
ROUGE-22024.020.130.10.130.110.150.110.040.04
ROUGE-L2024.020.130.10.180.150.180.140.070.05
ROUGE-12024.020.080.060.110.090.140.1100
SUMMAC2024.020.060.050.020.010.070.060.20.17