Consistency Analysis on Consistency Analysis 80 cases (test)
71.7Mean Consistency ScoreClaude-3.7-Sonnet
Evaluation Results
| Method | Links | |
|---|---|---|
| Claude-3.7-SonnetTemperature=0.12025.11 | 71.7 | |
| Claude-3.7-SonnetTemperature=0.22025.11 | 69.8 | |
| Claude-3.7-SonnetTemperature=0.32025.11 | 69 | |
| Claude-3.5-HaikuTemperature=0.12025.11 | 67.4 | |
| Claude-3.7-SonnetTemperature=0.42025.11 | 67.2 | |
| Claude-3.5-Sonnet-V2Temperature=0.22025.11 | 66.6 | |
| Claude-3.7-SonnetTemperature=0.52025.11 | 66.1 | |
| Claude-3.5-HaikuTemperature=0.22025.11 | 65 | |
| Claude-3.7-SonnetTemperature=0.62025.11 | 64.8 | |
| Claude-3.5-Sonnet-V2Temperature=0.32025.11 | 62.8 | |
| Claude-3.7-SonnetTemperature=0.82025.11 | 62.8 | |
| Claude-3.7-SonnetTemperature=0.72025.11 | 62.3 | |
| Claude-3.5-Sonnet-V2Temperature=0.42025.11 | 60.7 | |
| Claude-3.5-Sonnet-V2Temperature=0.62025.11 | 60.4 | |
| Claude-3.5-Sonnet-V2Temperature=0.52025.11 | 60.3 | |
| Claude-3.5-Sonnet-V2Temperature=0.12025.11 | 59.5 | |
| Claude-3.7-SonnetTemperature=0.92025.11 | 58.1 | |
| Claude-3.5-Sonnet-V2Temperature=0.82025.11 | 57.8 | |
| Claude-3.5-Sonnet-V2Temperature=0.72025.11 | 57.7 | |
| Claude-3.5-Sonnet-V2Temperature=0.92025.11 | 57 | |
| Claude-3.5-HaikuTemperature=0.32025.11 | 53.7 | |
| Claude-3.5-HaikuTemperature=0.42025.11 | 53 | |
| Claude-3-HaikuTemperature=0.12025.11 | 52.7 | |
| Llama-3.3-70BTemperature=0.22025.11 | 52.2 | |
| Llama-3.3-70BTemperature=0.12025.11 | 51.9 | |
| Claude-3.5-HaikuTemperature=0.52025.11 | 51.3 | |
| Nova-ProTemperature=0.22025.11 | 50.7 | |
| Claude-3.5-HaikuTemperature=0.62025.11 | 49.7 | |
| Nova-ProTemperature=0.52025.11 | 49.4 | |
| Claude-3-HaikuTemperature=0.32025.11 | 49 | |
| Claude-3-HaikuTemperature=0.22025.11 | 47.9 | |
| Llama-3.3-70BTemperature=0.32025.11 | 45.7 | |
| Nova-ProTemperature=0.42025.11 | 45.7 | |
| Nova-ProTemperature=0.32025.11 | 45.4 | |
| Claude-3.5-HaikuTemperature=0.72025.11 | 44.8 | |
| Nova-ProTemperature=0.62025.11 | 44.8 | |
| Claude-3.5-HaikuTemperature=0.82025.11 | 44.2 | |
| Nova-ProTemperature=0.12025.11 | 43.8 | |
| Claude-3-HaikuTemperature=0.42025.11 | 43.3 | |
| Claude-3-HaikuTemperature=0.52025.11 | 43.2 | |
| Claude-3.5-HaikuTemperature=0.92025.11 | 42.8 | |
| Nova-ProTemperature=0.82025.11 | 42 | |
| Llama-3.3-70BTemperature=0.42025.11 | 41.1 | |
| Nova-ProTemperature=0.92025.11 | 40.1 | |
| Llama-3.3-70BTemperature=0.62025.11 | 38.6 | |
| Nova-ProTemperature=0.72025.11 | 38 | |
| Claude-3-HaikuTemperature=0.82025.11 | 37.4 | |
| Llama-3.3-70BTemperature=0.82025.11 | 37.4 | |
| Claude-3-HaikuTemperature=0.72025.11 | 37.1 | |
| Llama-3.3-70BTemperature=0.72025.11 | 36.8 | |
| Claude-3-HaikuTemperature=0.92025.11 | 36.1 | |
| Llama-3.3-70BTemperature=0.52025.11 | 34.6 | |
| Claude-3-HaikuTemperature=0.62025.11 | 34.4 | |
| Llama-3.3-70BTemperature=0.92025.11 | 33.4 |