Complaint Classification on CFPB-Issue
77.88Macro-F1SKG-VLA
Evaluation Results
| Method | Links | |
|---|---|---|
| SKG-VLABackbone=Qwen2.5-3B, Variant=mm-our2026.05 | 77.88 | |
| Qwen2.5 (sft)Backbone=Qwen2.5-3B, Variant=sft2026.05 | 77.2 | |
| Qwen2.5 (pre)Backbone=Qwen2.5-3B, Variant=pre2026.05 | 76.51 | |
| SKG-VLABackbone=Qwen2.5-1.5B, Variant=mm-our2026.05 | 75.84 | |
| Qwen2.5-VL-3B-InstructBackbone=Qwen2.5-3B, Variant=Qwen2.5-VL-3B-Instruct2026.05 | 75.18 | |
| Qwen2.5 (sft)Backbone=Qwen2.5-1.5B, Variant=sft2026.05 | 75.16 | |
| Qwen2.5 (pre)Backbone=Qwen2.5-1.5B, Variant=pre2026.05 | 74.38 | |
| Qwen2.5 (llm)Backbone=Qwen2.5-3B, Variant=llm2026.05 | 73.46 | |
| Qwen2.5 (llm)Backbone=Qwen2.5-1.5B, Variant=llm2026.05 | 70.92 | |
| SKG-VLABackbone=Qwen2.5-0.5B, Variant=mm-our2026.05 | 69.08 | |
| Qwen2.5 (sft)Backbone=Qwen2.5-0.5B, Variant=sft2026.05 | 68.55 | |
| Qwen2.5 (pre)Backbone=Qwen2.5-0.5B, Variant=pre2026.05 | 67.41 | |
| Qwen2.5 (llm)Backbone=Qwen2.5-0.5B, Variant=llm2026.05 | 63.18 |