List your company
ResearchFormerly WizWand

Semantic Consistency on Consistency evaluation suite N=720 (test)

0.583Semantic Consistency ScoreClaude-3.5-Haiku
0.200280.299640.3990.49836Nov 27, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Claude-3.5-HaikuTemperature=0.12025.110.583
Claude-3.7-SonnetTemperature=0.12025.110.565
Claude-3.7-SonnetTemperature=0.22025.110.547
Claude-3.5-HaikuTemperature=0.22025.110.537
Claude-3.5-Sonnet-V2Temperature=0.22025.110.535
Claude-3.7-SonnetTemperature=0.32025.110.535
Claude-3.7-SonnetTemperature=0.42025.110.508
Claude-3.7-SonnetTemperature=0.52025.110.498
Claude-3.5-Sonnet-V2Temperature=0.32025.110.481
Claude-3.7-SonnetTemperature=0.62025.110.476
Claude-3.5-Sonnet-V2Temperature=0.12025.110.464
Claude-3.5-Sonnet-V2Temperature=0.42025.110.464
Claude-3.5-Sonnet-V2Temperature=0.52025.110.463
Claude-3.7-SonnetTemperature=0.82025.110.462
Claude-3-HaikuTemperature=0.12025.110.456
Claude-3.7-SonnetTemperature=0.72025.110.454
Claude-3.5-Sonnet-V2Temperature=0.62025.110.45
Claude-3.5-HaikuTemperature=0.32025.110.443
Claude-3.5-Sonnet-V2Temperature=0.82025.110.432
Claude-3.5-HaikuTemperature=0.52025.110.427
Claude-3.5-HaikuTemperature=0.42025.110.424
Claude-3.5-Sonnet-V2Temperature=0.72025.110.423
Claude-3.5-Sonnet-V2Temperature=0.92025.110.416
Claude-3.7-SonnetTemperature=0.92025.110.414
Claude-3-HaikuTemperature=0.22025.110.406
Nova-ProTemperature=0.22025.110.404
Claude-3-HaikuTemperature=0.32025.110.402
Llama-3.3-70BTemperature=0.22025.110.39
Llama-3.3-70BTemperature=0.12025.110.387
Claude-3.5-HaikuTemperature=0.62025.110.38
Nova-ProTemperature=0.52025.110.377
Claude-3.5-HaikuTemperature=0.72025.110.354
Nova-ProTemperature=0.32025.110.354
Nova-ProTemperature=0.42025.110.348
Nova-ProTemperature=0.12025.110.342
Claude-3.5-HaikuTemperature=0.82025.110.339
Nova-ProTemperature=0.62025.110.338
Claude-3-HaikuTemperature=0.42025.110.337
Claude-3-HaikuTemperature=0.52025.110.336
Llama-3.3-70BTemperature=0.32025.110.326
Claude-3.5-HaikuTemperature=0.92025.110.319
Nova-ProTemperature=0.82025.110.314
Nova-ProTemperature=0.92025.110.3
Llama-3.3-70BTemperature=0.42025.110.292
Claude-3-HaikuTemperature=0.72025.110.283
Nova-ProTemperature=0.72025.110.283
Claude-3-HaikuTemperature=0.82025.110.279
Claude-3-HaikuTemperature=0.92025.110.264
Claude-3-HaikuTemperature=0.62025.110.263
Llama-3.3-70BTemperature=0.62025.110.263
Llama-3.3-70BTemperature=0.82025.110.257
Llama-3.3-70BTemperature=0.72025.110.246
Llama-3.3-70BTemperature=0.52025.110.222
Llama-3.3-70BTemperature=0.92025.110.215