List your company
ResearchFormerly WizWand

Summarization on ACI-Bench (AlignScore)

72.5AlignScoreManual
58.87662.41365.9569.487Oct 3, 2024
Updated 8mo ago

Evaluation results

MethodLinks
ManualLLM=Llama3 8B, shots=02024.1072.5
ManualLLM=Claude3 Sonnet, shots=02024.1070.2
OPROLLM=Claude3 Sonnet, prompt_engineering=Automatic2024.1069.8
ManualLLM=Mistral 7B, shots=3, example_selection=ICL2024.1069
ManualLLM=Mistral 7B, shots=02024.1068
CriSPOLLM=Mistral 7B, prompt_engineering=Automatic2024.1067.8
ManualLLM=Claude3 Sonnet, shots=3, example_selection=ICL2024.1067.4
CriSPOLLM=Mistral 7B, shots=3, example_selection=ICL, prompt_engineering=Automatic2024.1067.2
ManualLLM=Claude Instant, shots=02024.1066.7
ManualLLM=Claude Instant, shots=3, example_selection=ICL2024.1066.3
CriSPOLLM=Claude Instant, shots=3, example_selection=ICL, prompt_engineering=Automatic2024.1065.6
OPROLLM=Mistral 7B, prompt_engineering=Automatic2024.1065.6
CriSPOLLM=Claude3 Sonnet, prompt_engineering=Automatic2024.1065
CriSPOLLM=Claude3 Sonnet, shots=3, example_selection=ICL, prompt_engineering=Automatic2024.1063.8
CriSPOLLM=Claude Instant, prompt_engineering=Automatic2024.1063.3
OPROLLM=Claude Instant, prompt_engineering=Automatic2024.1062.3
CriSPOLLM=Llama3 8B, optimizer=Claude3 Sonnet, prompt_engineering=Automatic2024.1062.3
Reference Summary2024.1061.4
OPROLLM=Llama3 8B, optimizer=Claude3 Sonnet, prompt_engineering=Automatic2024.1059.4