Chinese Baby Naming on CNames (test)
99.15ECMAGIC-HMO
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| MAGIC-HMOBackbone=GPT4o2025.11 | 99.15 | 2.32 | 96.22 | 5.18 | 97.69 | 2.55 | 99 | |
| MAGIC-HMOBackbone=DeepSeek2025.11 | 98.93 | 3.45 | 95.22 | 5.96 | 97.08 | 3 | 99.6 | |
| Few-shotBackbone=DeepSeek2025.11 | 98.02 | 4.5 | 84.25 | 19.03 | 91.14 | 9.85 | 76.8 | |
| MAGIC-HMOBackbone=GLM42025.11 | 97.83 | 4.37 | 92.94 | 8.31 | 95.38 | 4.45 | 98.8 | |
| MAGIC-HMOBackbone=Gemini2025.11 | 97.51 | 5.15 | 92.72 | 8.76 | 95.12 | 4.57 | 99.2 | |
| MAGIC-HMOBackbone=Qwen2025.11 | 96.72 | 5.95 | 92.7 | 8.28 | 94.71 | 4.64 | 99.8 | |
| Few-shotBackbone=GPT4o2025.11 | 95.34 | 7.95 | 77.68 | 22.88 | 86.51 | 12.8 | 96 | |
| MAGIC-HMOBackbone=Mistral2025.11 | 94.94 | 7.28 | 91.71 | 9.56 | 93.32 | 5.53 | 98.8 | |
| Few-shotBackbone=GLM42025.11 | 94.1 | 10.51 | 79.49 | 14.75 | 86.79 | 11 | 75.8 | |
| Few-shotBackbone=Qwen2025.11 | 94.07 | 9.74 | 76.43 | 16.59 | 85.25 | 12.7 | 60.4 | |
| Few-shotBackbone=Mistral2025.11 | 93.97 | 9.43 | 67.17 | 22.54 | 80.57 | 19.23 | 94 | |
| LLM-DBackbone=DeepSeek2025.11 | 93.9 | 8.81 | 81.21 | 14.59 | 87.56 | 10.31 | 96.6 | |
| Few-shotBackbone=Gemini2025.11 | 93.66 | 12.51 | 73.77 | 15.88 | 83.71 | 14.53 | 76.4 | |
| BaseBackbone=DeepSeek2025.11 | 93.53 | 9.84 | 85.29 | 13.66 | 89.41 | 7.19 | 69.2 | |
| CoTBackbone=DeepSeek2025.11 | 93.46 | 9.38 | 84.74 | 14.89 | 89.1 | 7.91 | 73.6 | |
| TDBBackbone=DeepSeek2025.11 | 93.4 | 10.01 | 84.91 | 14 | 89.15 | 7.5 | 72.2 | |
| Q2KwBackbone=DeepSeek2025.11 | 93.17 | 10.28 | 86.93 | 11.43 | 90.05 | 6.54 | 96 | |
| LLM-DBackbone=GLM42025.11 | 91.21 | 12.55 | 86.21 | 11.48 | 88.71 | 6.03 | 96.2 | |
| BaseBackbone=GLM42025.11 | 88.37 | 14.79 | 79.44 | 10.15 | 83.9 | 7.96 | 56.6 | |
| TDBBackbone=GLM42025.11 | 88.12 | 15 | 83.25 | 12.39 | 85.68 | 6.3 | 56.2 | |
| TDBBackbone=Qwen2025.11 | 87.34 | 15.52 | 82.85 | 11.45 | 85.1 | 6.61 | 44.8 | |
| BaseBackbone=GPT4o2025.11 | 86.08 | 17.34 | 79.29 | 13.87 | 82.69 | 7.15 | 94.8 | |
| Q2KwBackbone=GLM42025.11 | 85.95 | 18.39 | 80.4 | 11.19 | 83.18 | 6.93 | 91.4 | |
| LLM-DBackbone=Qwen2025.11 | 85.51 | 17.65 | 80.75 | 14.67 | 83.13 | 7.2 | 82.8 | |
| BaseBackbone=Qwen2025.11 | 85.03 | 18.75 | 76.29 | 11.28 | 80.66 | 8.52 | 44.2 | |
| BaseBackbone=Gemini2025.11 | 84.56 | 21.14 | 74.1 | 12.31 | 79.33 | 8.87 | 69.6 | |
| LLM-DBackbone=Mistral2025.11 | 84.19 | 17.56 | 75.88 | 12.43 | 80.03 | 8.95 | 97 | |
| Q2KwBackbone=Qwen2025.11 | 83.31 | 19.22 | 80.05 | 11.93 | 81.68 | 6.59 | 84.6 | |
| Q2KwBackbone=GPT4o2025.11 | 83 | 22.24 | 75.07 | 14.7 | 79.04 | 8.15 | 95.8 | |
| LLM-DBackbone=GPT4o2025.11 | 82.93 | 20.62 | 77.01 | 14.5 | 79.97 | 7.95 | 96 | |
| Q2KwBackbone=Gemini2025.11 | 82.81 | 22.03 | 77.41 | 14.41 | 80.11 | 7.2 | 76.6 | |
| CoTBackbone=Mistral2025.11 | 82.46 | 18.68 | 72.4 | 11.64 | 77.43 | 9.77 | 86.6 | |
| LLM-DBackbone=Gemini2025.11 | 82.15 | 21.93 | 76.84 | 15.75 | 79.49 | 7.61 | 87.6 | |
| BaseBackbone=Mistral2025.11 | 82.1 | 19.43 | 68.11 | 11.82 | 75.11 | 11.86 | 88.4 | |
| TDBBackbone=Gemini2025.11 | 81.5 | 23.16 | 73.11 | 17.05 | 77.31 | 8.49 | 81.2 | |
| TDBBackbone=Mistral2025.11 | 81.09 | 19.52 | 71.55 | 11.94 | 76.32 | 10.02 | 86.8 | |
| CoTBackbone=GLM42025.11 | 80.25 | 21.19 | 73.39 | 20.38 | 76.82 | 8.3 | 93.8 | |
| CoTBackbone=Gemini2025.11 | 80.17 | 23.87 | 72.28 | 18.61 | 76.22 | 8.66 | 87.4 | |
| TDBBackbone=GPT4o2025.11 | 80.07 | 22.6 | 72.81 | 18.45 | 76.44 | 8.26 | 96.2 | |
| Q2KwBackbone=Mistral2025.11 | 79.82 | 21.85 | 70.81 | 15.11 | 75.31 | 9.56 | 91.6 | |
| CoTBackbone=GPT4o2025.11 | 78.1 | 23.31 | 71.9 | 19.9 | 75 | 8.08 | 96.8 | |
| CoTBackbone=Qwen2025.11 | 76.98 | 23.99 | 70.75 | 24.08 | 73.86 | 8.33 | 91 |