List your company
ResearchFormerly WizWand

Summarization on Coverage dataset (test)

93.39PrecisionClaude 3 Sonnet
56.168465.831775.49585.1583Aug 24, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Claude 3 SonnetJudge=Claude 3 Sonnet2024.0893.3985.55
GPT4oJudge=Claude 3 Sonnet2024.0893.2586.6
Gemini 1.5 FlashJudge=Claude 3 Sonnet2024.0891.9585.05
GPT4oJudge=GPT4o2024.0890.7182
Claude 3 SonnetJudge=GPT4o2024.0888.0478.18
Gemini 1.5 FlashJudge=GPT4o2024.0887.979.14
GPT4oJudge=Gemini 1.5 Flash2024.0887.167.45
LLaMA3 8BJudge=Claude 3 Sonnet, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0887.0278.42
Claude 3 SonnetJudge=Gemini 1.5 Flash2024.0886.764.1
Mistral 7BJudge=Claude 3 Sonnet, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0886.278.44
Gemma 7BJudge=Claude 3 Sonnet, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0886.1977.41
Gemini 1.5 FlashJudge=Gemini 1.5 Flash2024.0885.6566.45
Mistral 7BJudge=GPT4o, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0876.3869.65
LLaMA3 8BJudge=GPT4o, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0875.6770.54
Gemma 2BJudge=Claude 3 Sonnet, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0874.8964.09
Gemma 7BJudge=Gemini 1.5 Flash, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0874.5953.92
Gemma 7BJudge=GPT4o, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0873.5468.58
Mistral 7BJudge=Gemini 1.5 Flash, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0872.7450.15
LLaMA3 8BJudge=Gemini 1.5 Flash, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0872.7452.23
Gemma 2BJudge=Gemini 1.5 Flash, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0861.942.15
Gemma 2BJudge=GPT4o, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0857.654.49