List your company

Personalized Summarization on PerSum (test)

94.37Product AC ScoreRehearsal
81.702884.991488.2891.5686Mar 1, 2025

Evaluation results

MethodLinks
RehearsalModel=GPT-4-turbo2025.0394.3788.1992.6686.5196.2686.8290.8
RehearsalModel=GPT-4o2025.0394.0588.4592.5887.1996.4687.8291.07
OnlySumModel=CharacterGLM-42025.0393.5288.1488.9683.7191.4281.0787.8
RehearsalModel=Qwen-turbo2025.0393.4887.9793.7989.8294.9887.4591.25
OnlySumModel=Qwen-turbo2025.0393.387.9688.9485.0691.781.7288.13
PerSumModel=GPT-4o2025.0392.8888.7386.5782.4586.7576.6685.67
Ana+PerSumModel=Qwen-turbo2025.0392.6588.6292.3589.2494.1386.1990.53
Sum+PerChanModel=Qwen-turbo2025.0392.5889.1891.5988.9792.8787.9990.53
Ana+PerSumModel=GPT-4o2025.0392.487.8193.2289.4993.484.6790.16
RehearsalModel=CharacterGLM-42025.0392.2787.6792.8489.3593.5685.9890.28
PerSumModel=CharacterGLM-42025.0392.1987.185.8682.4885.5776.1384.89
Ana+PerSumModel=GPT-4-turbo2025.0392.0386.9292.1588.5492.7483.6289.34
RehearsalModel=GPT-3.5-turbo2025.0391.8786.4188.9285.3489.7881.687.32
OnlySumModel=GPT-4o2025.0391.648687.582.3589.680.1584.87
Sum+PerChanModel=CharacterGLM-42025.0390.3685.4288.4386.2789.5482.3687.07
PerSumModel=GPT-4-turbo2025.0390.3385.9884.3880.9983.4173.9983.18
Ana+PerSumModel=CharacterGLM-42025.0389.4485.2490.9388.1391.5983.9188.21
Sum+PerChanModel=GPT-4o2025.0388.9184.5290.8388.193.6888.2289.04
OnlySumModel=GPT-4-turbo2025.0388.5384.4681.627878.8269.7880.2
PerSumModel=Qwen-turbo2025.0388.5384.4681.627878.8269.7880.2
OnlySumModel=GPT-3.5-turbo2025.0388.4382.6679.1875.8377.7769.2778.86
Sum+PerChanModel=GPT-4-turbo2025.0387.2783.5484.6282.2282.8976.3982.82
Ana+PerSumModel=GPT-3.5-turbo2025.0382.6377.9183.8180.8580.2672.7579.7
Sum+PerChanModel=GPT-3.5-turbo2025.0382.5677.9488.5986.3180.5175.4181.89
PerSumModel=GPT-3.5-turbo2025.0382.1978.147471.9973.9366.3274.43