Calibration and Measurement on 14 social science constructs (Full Dataset)
0.18T-ECEQwen2.5-7B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Qwen2.5-7BMethod=Logit (Geom.)2026.05 | 0.18 | 0.262 | 0.427 | |
| DeepSeek-R1-7BMethod=Logit (Geom.)2026.05 | 0.207 | 0.229 | 0.262 | |
| Gemma-2-9BMethod=Logit (Geom.)2026.05 | 0.212 | 0.258 | 0.425 | |
| Ministral-8BMethod=Logit (Geom.)2026.05 | 0.228 | 0.261 | 0.254 | |
| GPT-5-nanoMethod=Verbal2026.05 | 0.342 | 0.351 | 0.501 | |
| Ministral-8BMethod=Logit (P-true)2026.05 | 0.357 | 0.321 | 0.254 | |
| DeepSeek-V3.2Method=Verbal2026.05 | 0.396 | 0.4 | 0.537 | |
| DeepSeek-R1-7BMethod=Verbal2026.05 | 0.425 | 0.412 | 0.287 | |
| Qwen2.5-7BMethod=Verbal2026.05 | 0.459 | 0.441 | 0.418 | |
| GPT-5-miniMethod=Verbal2026.05 | 0.466 | 0.44 | 0.605 | |
| Gemma-2-9BMethod=Verbal2026.05 | 0.478 | 0.453 | 0.424 | |
| Gemma-2-9BMethod=Logit (P-true)2026.05 | 0.513 | 0.482 | 0.425 | |
| Qwen3.5-FlashMethod=Verbal2026.05 | 0.516 | 0.495 | 0.587 | |
| Ministral-8BMethod=Verbal2026.05 | 0.54 | 0.508 | 0.485 | |
| Qwen2.5-7BMethod=Logit (P-true)2026.05 | 0.597 | 0.58 | 0.427 | |
| DeepSeek-R1-7BMethod=Logit (P-true)2026.05 | 0.693 | 0.665 | 0.262 |