Semantic Consistency on Consistency evaluation suite N=720 (test)
0.583Semantic Consistency ScoreClaude-3.5-Haiku
Evaluation Results
| Method | Links | |
|---|---|---|
| Claude-3.5-HaikuTemperature=0.12025.11 | 0.583 | |
| Claude-3.7-SonnetTemperature=0.12025.11 | 0.565 | |
| Claude-3.7-SonnetTemperature=0.22025.11 | 0.547 | |
| Claude-3.5-HaikuTemperature=0.22025.11 | 0.537 | |
| Claude-3.5-Sonnet-V2Temperature=0.22025.11 | 0.535 | |
| Claude-3.7-SonnetTemperature=0.32025.11 | 0.535 | |
| Claude-3.7-SonnetTemperature=0.42025.11 | 0.508 | |
| Claude-3.7-SonnetTemperature=0.52025.11 | 0.498 | |
| Claude-3.5-Sonnet-V2Temperature=0.32025.11 | 0.481 | |
| Claude-3.7-SonnetTemperature=0.62025.11 | 0.476 | |
| Claude-3.5-Sonnet-V2Temperature=0.12025.11 | 0.464 | |
| Claude-3.5-Sonnet-V2Temperature=0.42025.11 | 0.464 | |
| Claude-3.5-Sonnet-V2Temperature=0.52025.11 | 0.463 | |
| Claude-3.7-SonnetTemperature=0.82025.11 | 0.462 | |
| Claude-3-HaikuTemperature=0.12025.11 | 0.456 | |
| Claude-3.7-SonnetTemperature=0.72025.11 | 0.454 | |
| Claude-3.5-Sonnet-V2Temperature=0.62025.11 | 0.45 | |
| Claude-3.5-HaikuTemperature=0.32025.11 | 0.443 | |
| Claude-3.5-Sonnet-V2Temperature=0.82025.11 | 0.432 | |
| Claude-3.5-HaikuTemperature=0.52025.11 | 0.427 | |
| Claude-3.5-HaikuTemperature=0.42025.11 | 0.424 | |
| Claude-3.5-Sonnet-V2Temperature=0.72025.11 | 0.423 | |
| Claude-3.5-Sonnet-V2Temperature=0.92025.11 | 0.416 | |
| Claude-3.7-SonnetTemperature=0.92025.11 | 0.414 | |
| Claude-3-HaikuTemperature=0.22025.11 | 0.406 | |
| Nova-ProTemperature=0.22025.11 | 0.404 | |
| Claude-3-HaikuTemperature=0.32025.11 | 0.402 | |
| Llama-3.3-70BTemperature=0.22025.11 | 0.39 | |
| Llama-3.3-70BTemperature=0.12025.11 | 0.387 | |
| Claude-3.5-HaikuTemperature=0.62025.11 | 0.38 | |
| Nova-ProTemperature=0.52025.11 | 0.377 | |
| Claude-3.5-HaikuTemperature=0.72025.11 | 0.354 | |
| Nova-ProTemperature=0.32025.11 | 0.354 | |
| Nova-ProTemperature=0.42025.11 | 0.348 | |
| Nova-ProTemperature=0.12025.11 | 0.342 | |
| Claude-3.5-HaikuTemperature=0.82025.11 | 0.339 | |
| Nova-ProTemperature=0.62025.11 | 0.338 | |
| Claude-3-HaikuTemperature=0.42025.11 | 0.337 | |
| Claude-3-HaikuTemperature=0.52025.11 | 0.336 | |
| Llama-3.3-70BTemperature=0.32025.11 | 0.326 | |
| Claude-3.5-HaikuTemperature=0.92025.11 | 0.319 | |
| Nova-ProTemperature=0.82025.11 | 0.314 | |
| Nova-ProTemperature=0.92025.11 | 0.3 | |
| Llama-3.3-70BTemperature=0.42025.11 | 0.292 | |
| Claude-3-HaikuTemperature=0.72025.11 | 0.283 | |
| Nova-ProTemperature=0.72025.11 | 0.283 | |
| Claude-3-HaikuTemperature=0.82025.11 | 0.279 | |
| Claude-3-HaikuTemperature=0.92025.11 | 0.264 | |
| Claude-3-HaikuTemperature=0.62025.11 | 0.263 | |
| Llama-3.3-70BTemperature=0.62025.11 | 0.263 | |
| Llama-3.3-70BTemperature=0.82025.11 | 0.257 | |
| Llama-3.3-70BTemperature=0.72025.11 | 0.246 | |
| Llama-3.3-70BTemperature=0.52025.11 | 0.222 | |
| Llama-3.3-70BTemperature=0.92025.11 | 0.215 |