Strategy Prediction on ToM-BPD (test)
39.78Strategy AccuracyTTBYS
Evaluation Results
| Method | Links | |
|---|---|---|
| TTBYSBackbone=Qwen-3-8B, Enhancement=TTBYS2026.05 | 39.78 | |
| TTBYSBackbone=LLaMA-3.1-8B-Instruct, Enhancement=TTBYS2026.05 | 37.76 | |
| TTBYSBackbone=Mixtral-7B-Instruct, Enhancement=TTBYS2026.05 | 36.79 | |
| GPT-4o-mini + MMBackbone=GPT-4o-mini, Enhancement=MM2026.05 | 28.18 | |
| GPT-4o-mini + HMBackbone=GPT-4o-mini, Enhancement=HM2026.05 | 27.72 | |
| GPT-5 + MMBackbone=GPT-5, Enhancement=MM2026.05 | 27.14 | |
| GPT-4o-miniBackbone=GPT-4o-mini, Enhancement=Basic2026.05 | 27.13 | |
| GPT-4o-mini + CoTBackbone=GPT-4o-mini, Enhancement=CoT2026.05 | 26.68 | |
| GPT-5 + HMBackbone=GPT-5, Enhancement=HM2026.05 | 26.68 | |
| Gemini-3-pro-high + MMBackbone=Gemini-3-pro-high, Enhancement=MM2026.05 | 24.59 | |
| Gemini-3-pro-high + HMBackbone=Gemini-3-pro-high, Enhancement=HM2026.05 | 23.68 | |
| Qwen-3-8B + HMBackbone=Qwen-3-8B, Enhancement=HM2026.05 | 23.68 | |
| GPT-5Backbone=GPT-5, Enhancement=Basic2026.05 | 22.81 | |
| LLaMA-3.1-8B-Instruct + MMBackbone=LLaMA-3.1-8B-Instruct, Enhancement=MM2026.05 | 22.63 | |
| LLaMA-3.1-8B-Instruct + HMBackbone=LLaMA-3.1-8B-Instruct, Enhancement=HM2026.05 | 22.12 | |
| Qwen-3-8B + MMBackbone=Qwen-3-8B, Enhancement=MM2026.05 | 21.89 | |
| Qwen-3-8BBackbone=Qwen-3-8B, Enhancement=Basic2026.05 | 21.42 | |
| GPT-5 + CoTBackbone=GPT-5, Enhancement=CoT2026.05 | 21.16 | |
| Gemini-3-pro-highBackbone=Gemini-3-pro-high, Enhancement=Basic2026.05 | 20.67 | |
| Qwen-3-8B + CoTBackbone=Qwen-3-8B, Enhancement=CoT2026.05 | 19.86 | |
| Gemini-3-pro-high + CoTBackbone=Gemini-3-pro-high, Enhancement=CoT2026.05 | 19.84 | |
| Mixtral-7B-Instruct + HMBackbone=Mixtral-7B-Instruct, Enhancement=HM2026.05 | 17.84 | |
| Mixtral-7B-Instruct + CoTBackbone=Mixtral-7B-Instruct, Enhancement=CoT2026.05 | 17.64 | |
| Mixtral-7B-Instruct + MMBackbone=Mixtral-7B-Instruct, Enhancement=MM2026.05 | 17.12 | |
| LLaMA-3.1-8B-Instruct + CoTBackbone=LLaMA-3.1-8B-Instruct, Enhancement=CoT2026.05 | 16.8 | |
| Mixtral-7B-InstructBackbone=Mixtral-7B-Instruct, Enhancement=Basic2026.05 | 16.41 | |
| LLaMA-3.1-8B-InstructBackbone=LLaMA-3.1-8B-Instruct, Enhancement=Basic2026.05 | 14.03 |