List your company
ResearchFormerly WizWand

Structural Consistency on Consistency Evaluation Dataset (N=720) (test)

1Structural Consistency ScoreClaude-3.7-Sonnet
0.644320.736660.8290.92134Nov 27, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Claude-3.7-SonnetTemperature=0.12025.111
Claude-3.7-SonnetTemperature=0.22025.111
Claude-3.7-SonnetTemperature=0.32025.111
Claude-3.7-SonnetTemperature=0.42025.111
Claude-3.7-SonnetTemperature=0.52025.111
Claude-3.7-SonnetTemperature=0.62025.111
Claude-3.7-SonnetTemperature=0.72025.111
Claude-3.7-SonnetTemperature=0.82025.111
Claude-3.7-SonnetTemperature=0.92025.110.988
Claude-3.5-Sonnet-V2Temperature=0.22025.110.975
Claude-3.5-Sonnet-V2Temperature=0.32025.110.963
Claude-3.5-Sonnet-V2Temperature=0.62025.110.963
Claude-3.5-Sonnet-V2Temperature=0.42025.110.95
Claude-3.5-Sonnet-V2Temperature=0.52025.110.95
Claude-3.5-Sonnet-V2Temperature=0.72025.110.95
Claude-3.5-Sonnet-V2Temperature=0.92025.110.95
Claude-3.5-Sonnet-V2Temperature=0.82025.110.938
Claude-3.5-Sonnet-V2Temperature=0.12025.110.875
Claude-3.5-HaikuTemperature=0.22025.110.869
Llama-3.3-70BTemperature=0.22025.110.863
Claude-3.5-HaikuTemperature=0.12025.110.86
Llama-3.3-70BTemperature=0.62025.110.85
Llama-3.3-70BTemperature=0.82025.110.838
Llama-3.3-70BTemperature=0.92025.110.838
Llama-3.3-70BTemperature=0.12025.110.825
Llama-3.3-70BTemperature=0.32025.110.825
Llama-3.3-70BTemperature=0.72025.110.825
Llama-3.3-70BTemperature=0.42025.110.8
Llama-3.3-70BTemperature=0.52025.110.8
Nova-ProTemperature=0.52025.110.787
Claude-3-HaikuTemperature=0.32025.110.781
Claude-3.5-HaikuTemperature=0.32025.110.776
Nova-ProTemperature=0.22025.110.775
Claude-3.5-HaikuTemperature=0.62025.110.771
Claude-3.5-HaikuTemperature=0.42025.110.768
Claude-3-HaikuTemperature=0.42025.110.767
Claude-3-HaikuTemperature=0.52025.110.758
Claude-3.5-HaikuTemperature=0.52025.110.757
Claude-3-HaikuTemperature=0.12025.110.755
Claude-3-HaikuTemperature=0.22025.110.75
Nova-ProTemperature=0.62025.110.749
Nova-ProTemperature=0.82025.110.748
Nova-ProTemperature=0.42025.110.739
Claude-3-HaikuTemperature=0.92025.110.722
Claude-3.5-HaikuTemperature=0.82025.110.722
Nova-ProTemperature=0.12025.110.722
Claude-3-HaikuTemperature=0.82025.110.708
Claude-3.5-HaikuTemperature=0.92025.110.704
Claude-3.5-HaikuTemperature=0.72025.110.703
Nova-ProTemperature=0.32025.110.7
Claude-3-HaikuTemperature=0.72025.110.682
Claude-3-HaikuTemperature=0.62025.110.679
Nova-ProTemperature=0.92025.110.673
Nova-ProTemperature=0.72025.110.658