Response Similarity Evaluation on NUMINA
1.848C-ScoreQwQ-32B-Preview
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| QwQ-32B-PreviewReference Model=OpenAI-O1-Preview2025.01 | 1.848 | 1.623 | 1.157 | 3.85 | |
| OpenAI-o3-miniReference Model=OpenAI-O1-Preview2025.01 | 1.845 | 1.867 | 1.865 | 4.665 | |
| DeepSeek-R1Reference Model=OpenAI-O1-Preview2025.01 | 1.841 | 1.863 | 1.907 | 4.679 | |
| OpenAI-o1-miniReference Model=OpenAI-O1-Preview2025.01 | 1.83 | 1.863 | 1.903 | 4.676 | |
| OpenAI-o1-1217Reference Model=OpenAI-O1-Preview2025.01 | 1.786 | 1.818 | 1.772 | 4.498 | |
| Gemini-2.0-thinkingReference Model=OpenAI-O1-Preview2025.01 | 1.751 | 1.751 | 1.763 | 4.425 | |
| GLM-zero-previewReference Model=OpenAI-O1-Preview2025.01 | 1.746 | 1.64 | 1.41 | 4.016 | |
| DeepSeek-R1-Distill-Llama-70BReference Model=OpenAI-O1-Preview2025.01 | 1.662 | 1.524 | 1.185 | 3.757 | |
| DeepSeek-R1-Distill-Qwen-32BReference Model=OpenAI-O1-Preview2025.01 | 1.652 | 1.487 | 1.11 | 3.653 |