List your company
ResearchFormerly WizWand

Summarization on SAMSum (AlignScore)

89.5AlignScoreOPRO
79.51682.10884.787.292Oct 3, 2024
Updated 8mo ago

Evaluation results

MethodLinks
OPROLLM=Claude3 Sonnet, prompt_engineering=Automatic2024.1089.5
OPROLLM=Llama3 8B, optimizer=Claude3 Sonnet, prompt_engineering=Automatic2024.1088.9
ManualLLM=Llama3 8B, shots=02024.1088.8
OPROLLM=Mistral 7B, prompt_engineering=Automatic2024.1088.4
ManualLLM=Claude3 Sonnet, shots=02024.1087.9
CriSPOLLM=Mistral 7B, prompt_engineering=Automatic2024.1087.7
CriSPOLLM=Llama3 8B, optimizer=Claude3 Sonnet, prompt_engineering=Automatic2024.1087.7
ManualLLM=Mistral 7B, shots=02024.1087.6
CriSPOLLM=Mistral 7B, shots=3, example_selection=ICL, prompt_engineering=Automatic2024.1087.4
ManualLLM=Claude3 Sonnet, shots=3, example_selection=ICL2024.1087.2
CriSPOLLM=Claude3 Sonnet, prompt_engineering=Automatic2024.1087
ManualLLM=Mistral 7B, shots=3, example_selection=ICL2024.1086.8
ManualLLM=Claude Instant, shots=3, example_selection=ICL2024.1086.6
ManualLLM=Claude Instant, shots=02024.1085.7
CriSPOLLM=Claude Instant, prompt_engineering=Automatic2024.1085.3
OPROLLM=Claude Instant, prompt_engineering=Automatic2024.1084.5
CriSPOLLM=Claude3 Sonnet, shots=3, example_selection=ICL, prompt_engineering=Automatic2024.1084.4
CriSPOLLM=Claude Instant, shots=3, example_selection=ICL, prompt_engineering=Automatic2024.1083.9
Reference Summary2024.1079.9