List your company
ResearchFormerly WizWand

Coding on Coverage (test)

94.57PrecisionGPT4o
61.019669.729878.4487.1502Aug 24, 2024
Updated 8mo ago

Evaluation results

MethodLinks
GPT4oJudge=Claude 3 Sonnet2024.0894.5786.32
Claude 3 SonnetJudge=Claude 3 Sonnet2024.0893.8287.42
Gemini 1.5 FlashJudge=Claude 3 Sonnet2024.0893.5982.92
GPT4oJudge=Gemini 1.5 Flash2024.0890.7858.43
Gemini 1.5 FlashJudge=Gemini 1.5 Flash2024.0890.6264.21
Gemma 7BJudge=Claude 3 Sonnet, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0890.4780.26
GPT4oJudge=GPT4o2024.0890.3175.18
Claude 3 SonnetJudge=Gemini 1.5 Flash2024.0889.8460.46
Claude 3 SonnetJudge=GPT4o2024.0888.7675.23
Gemini 1.5 FlashJudge=GPT4o2024.0888.5175.62
Gemma 7BJudge=Gemini 1.5 Flash, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0884.6661.23
LLaMA3 8BJudge=Claude 3 Sonnet, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0883.9773.51
Mistral 7BJudge=Claude 3 Sonnet, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0881.2569.1
Gemma 2BJudge=Claude 3 Sonnet, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0880.9267.24
Gemma 7BJudge=GPT4o, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0880.5671.92
LLaMA3 8BJudge=GPT4o, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0877.4769.46
LLaMA3 8BJudge=Gemini 1.5 Flash, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0875.5551.1
Gemma 2BJudge=Gemini 1.5 Flash, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0872.9844.08
Mistral 7BJudge=Gemini 1.5 Flash, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0872.3945.25
Mistral 7BJudge=GPT4o, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0868.3261.01
Gemma 2BJudge=GPT4o, Fine-tuned=128K synthetic dataset via LlamaDuo2024.0862.3156.48