Intent Classification on MIntRec 2.0
67.37AccuracyIntPro
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| IntProBackbone=Qwen3-4B, Training strategy=IntPro (Ours)2026.02 | 67.37 | — | 56.68 | 66.59 | |
| MIntRec2.0Language=English, Modality=Text+Video+Audio, Fusion Strategy=Late2025.11 | 67.2 | 66.8 | — | — | |
| Naive GRPOBackbone=Qwen3-4B, Training strategy=Naive GRPO2026.02 | 66.12 | — | 54.82 | 66.45 | |
| SFT with Answer-onlyBackbone=Qwen3-4B, Training strategy=SFT with Answer-only2026.02 | 65.14 | — | 55.37 | 65.65 | |
| IntProBackbone=Qwen2.5-3B, Training strategy=IntPro (Ours)2026.02 | 64.93 | — | 57.99 | 63.54 | |
| SFT with Answer-onlyBackbone=Qwen2.5-3B, Training strategy=SFT with Answer-only2026.02 | 63.52 | — | 58.12 | 62.63 | |
| SFT with Retrieval-conditionedBackbone=Qwen3-4B, Training strategy=SFT with Retrieval-conditioned2026.02 | 62.85 | — | 53.92 | 63.4 | |
| Naive GRPOBackbone=Qwen2.5-3B, Training strategy=Naive GRPO2026.02 | 61.3 | — | 53.97 | 59.82 | |
| SFT with Retrieval-conditionedBackbone=Qwen2.5-3B, Training strategy=SFT with Retrieval-conditioned2026.02 | 61.14 | — | 56.52 | 60.65 | |
| MAG-BERTBackbone=MAG-BERT2026.02 | 60.58 | — | 55.17 | 59.68 | |
| IntProBackbone=Llama3.2-3B, Training strategy=IntPro (Ours)2026.02 | 59.24 | — | 48.72 | 57.85 | |
| SFT with Answer-onlyBackbone=Llama3.2-3B, Training strategy=SFT with Answer-only2026.02 | 58.16 | — | 48.23 | 57.01 | |
| Naive GRPOBackbone=Llama3.2-3B, Training strategy=Naive GRPO2026.02 | 57.67 | — | 43.46 | 56.68 | |
| SFT with Retrieval-conditionedBackbone=Llama3.2-3B, Training strategy=SFT with Retrieval-conditioned2026.02 | 55.62 | — | 47.05 | 55.13 | |
| RoBERTa-baseBackbone=RoBERTa-base2026.02 | 46.4 | — | 28.44 | 39.26 | |
| BERT-baseBackbone=BERT-base2026.02 | 42.49 | — | 23.44 | 33.16 | |
| GPT-4o (w/ retrieval)Backbone=GPT-4o, Retrieval usage=true2026.02 | 41.84 | — | 30.56 | 43.68 | |
| Qwen3-30B-A3B (w/ retrieval)Backbone=Qwen3-30B-A3B, Retrieval usage=true2026.02 | 40.23 | — | 28.89 | 42.15 | |
| GPT-4oBackbone=GPT-4o2026.02 | 38.48 | — | 26.82 | 40.02 | |
| Qwen3-30B-A3BBackbone=Qwen3-30B-A3B2026.02 | 36.21 | — | 24.77 | 37.89 |