Online Drama Performance Evaluation on HAMLET English
79.5Character ScoreClaude-4-sonnet-Thinking
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Claude-4-sonnet-ThinkingModel Reasoning Category=Reasoning Models, Sampling Strategy=greedy2025.07 | 79.5 | 78.4 | 79.04 | 78.98 | |
| Claude-4-sonnetModel Reasoning Category=Non-Reasoning Models, Sampling Strategy=greedy2025.07 | 76.5 | 77.3 | 76.96 | 76.92 | |
| Higgs-Llama-3-70BModel Reasoning Category=Non-Reasoning Models, Sampling Strategy=greedy2025.07 | 72 | 78.5 | 66.22 | 72.24 | |
| Qwen3-235B-A22B-ThinkingModel Reasoning Category=Reasoning Models, Sampling Strategy=greedy2025.07 | 70.5 | 71 | 70.72 | 70.74 | |
| Qwen3-235B-A22BModel Reasoning Category=Non-Reasoning Models, Sampling Strategy=greedy2025.07 | 69.5 | 69.8 | 69.65 | 69.65 | |
| Qwen3-32B-ThinkingModel Reasoning Category=Reasoning Models, Sampling Strategy=greedy2025.07 | 69.5 | 68.8 | 69 | 69.1 | |
| OpenAI-o3Model Reasoning Category=Reasoning Models, Sampling Strategy=greedy2025.07 | 69 | 69.95 | 69.4 | 69.45 | |
| DeepSeek-R1-0528Model Reasoning Category=Reasoning Models, Sampling Strategy=greedy2025.07 | 66 | 67.1 | 66.64 | 66.58 | |
| Claude-3.7-sonnetModel Reasoning Category=Non-Reasoning Models, Sampling Strategy=greedy2025.07 | 65.8 | 66.94 | 65.98 | 66.24 | |
| Qwen3-32BModel Reasoning Category=Non-Reasoning Models, Sampling Strategy=greedy2025.07 | 65 | 65.88 | 65.2 | 65.36 | |
| GPT-4.1Model Reasoning Category=Non-Reasoning Models, Sampling Strategy=greedy2025.07 | 63.5 | 62.49 | 62.98 | 62.99 | |
| Claude-3.5-sonnetModel Reasoning Category=Non-Reasoning Models, Sampling Strategy=greedy2025.07 | 61 | 62.15 | 62.1 | 61.75 | |
| Gemini-2.5-proModel Reasoning Category=Reasoning Models, Sampling Strategy=greedy2025.07 | 61 | 62.22 | 61.7 | 61.64 | |
| GPT-4.5-previewModel Reasoning Category=Non-Reasoning Models, Sampling Strategy=greedy2025.07 | 59.21 | 60 | 59.92 | 59.71 | |
| Magistral-Small-2506Model Reasoning Category=Reasoning Models, Sampling Strategy=greedy2025.07 | 59 | 60 | 59.74 | 59.58 | |
| DeepSeek-V3-0324Model Reasoning Category=Non-Reasoning Models, Sampling Strategy=greedy2025.07 | 54 | 55.13 | 55 | 54.71 | |
| Minimax-M1Model Reasoning Category=Reasoning Models, Sampling Strategy=greedy2025.07 | 51.5 | 52.32 | 52 | 51.94 | |
| Qwen3-8B-ThinkingModel Reasoning Category=Reasoning Models, Sampling Strategy=greedy2025.07 | 50 | 51.61 | 51 | 50.87 | |
| Llama-3.1-70BModel Reasoning Category=Non-Reasoning Models, Sampling Strategy=greedy2025.07 | 49.8 | 49 | 48.86 | 49.22 | |
| Mistral-Small-3.2-24BModel Reasoning Category=Non-Reasoning Models, Sampling Strategy=greedy2025.07 | 48 | 48.5 | 48.22 | 48.24 | |
| Qwen3-8BModel Reasoning Category=Non-Reasoning Models, Sampling Strategy=greedy2025.07 | 47.5 | 46.8 | 47 | 47.1 | |
| Gemini-2.5-flashModel Reasoning Category=Non-Reasoning Models, Sampling Strategy=greedy2025.07 | 46 | 47.1 | 46.7 | 46.6 | |
| Llama-3.1-8BModel Reasoning Category=Non-Reasoning Models, Sampling Strategy=greedy2025.07 | 35 | 36.01 | 35.52 | 35.51 |