List your company
ResearchFormerly WizWand

Closed QA on Coverage (test)

98.25PrecisionGemini 1.5 Flash
66.0174.3882.7591.12Aug 24, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Gemini 1.5 FlashJudge=Claude 3 Sonnet2024.0898.2597.41
Claude 3 SonnetJudge=Claude 3 Sonnet2024.0897.693.95
GPT4oJudge=Claude 3 Sonnet2024.0897.2192.56
GPT4oJudge=GPT4o2024.0895.4584.23
Gemini 1.5 FlashJudge=Gemini 1.5 Flash2024.089585.66
Gemini 1.5 FlashJudge=GPT4o2024.0894.6387.43
Claude 3 SonnetJudge=GPT4o2024.0894.0385.28
Claude 3 SonnetJudge=Gemini 1.5 Flash2024.0893.6676.33
GPT4oJudge=Gemini 1.5 Flash2024.0893.5875.58
Gemma 7BJudge=Claude 3 Sonnet, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0888.8383.95
Mistral 7BJudge=Claude 3 Sonnet, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0888.2584.77
LLaMA3 8BJudge=Claude 3 Sonnet, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0886.0377.64
Mistral 7BJudge=GPT4o, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0883.6381.36
Gemma 7BJudge=Gemini 1.5 Flash, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0882.5172.24
Mistral 7BJudge=Gemini 1.5 Flash, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0882.0473.95
Gemma 7BJudge=GPT4o, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0881.8579.02
Gemma 2BJudge=Claude 3 Sonnet, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0880.2270.2
LLaMA3 8BJudge=Gemini 1.5 Flash, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0879.0968.78
LLaMA3 8BJudge=GPT4o, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0875.5572.62
Gemma 2BJudge=Gemini 1.5 Flash, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0870.3359.68
Gemma 2BJudge=GPT4o, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0867.2567.41