Hierarchical classification on HTS CBP-NY (N=1,181)
97.8Success RateACTIONRATING
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| ACTIONRATINGBase Model=Claude Opus 4.6, Threshold (τ)=102026.06 | 97.8 | 87.2 | 82 | 75.2 | 69.5 | 67 | 5.4 | |
| Kimi K2Model source=Open-Source, Protocol=Baseline MDP, # Params=1T2026.06 | 97.6 | 76.8 | 67.6 | 56.8 | 48.6 | 44.1 | 5.7 | |
| CoT-Ask-if-UnsureBase Model=Claude Opus 4.62026.06 | 97.5 | 80.6 | 71.5 | 63 | 55.6 | 52 | 5.5 | |
| Claude Opus 4.6Model source=Closed-Source, Protocol=Baseline MDP2026.06 | 97.3 | 79.3 | 70.9 | 61.8 | 54.4 | 50.8 | 5.6 | |
| Minimax M2Model source=Open-Source, Protocol=Baseline MDP, # Params=230B2026.06 | 96.8 | 67.6 | 55.5 | 45.5 | 38.8 | 35.4 | 6.1 | |
| Mistral Large 3Model source=Open-Source, Protocol=Baseline MDP, # Params=123B2026.06 | 96.7 | 72.2 | 60.8 | 49.9 | 42.3 | 38.8 | 5.9 | |
| Claude Haiku 4.5Model source=Closed-Source, Protocol=Baseline MDP2026.06 | 96.5 | 72.2 | 61.3 | 49.8 | 42.5 | 37.8 | 6.5 | |
| GPT-OSS 120BModel source=Open-Source, Protocol=Baseline MDP, # Params=120B2026.06 | 96.5 | 72.9 | 61.3 | 49.9 | 41.3 | 36.9 | 6 | |
| Self-Consistency (N=3)Base Model=Claude Opus 4.6, N=32026.06 | 96.4 | 85.3 | 77.4 | 68.9 | 62.9 | 59.5 | 6.1 | |
| Claude Sonnet 4.5Model source=Closed-Source, Protocol=Baseline MDP2026.06 | 95.1 | 77.6 | 67.2 | 56.4 | 50.5 | 47.2 | 6.7 | |
| Qwen3 235BModel source=Open-Source, Protocol=Baseline MDP, # Params=235B2026.06 | 93.6 | 65.9 | 54.7 | 44.2 | 36.6 | 32.9 | 6.9 | |
| DeepSeek V3Model source=Open-Source, Protocol=Baseline MDP, # Params=671B2026.06 | 90 | 75.5 | 65.2 | 53.7 | 45.9 | 41.4 | 6.2 |