Complaint Classification on CFPB-Product
88.41AccuracySKG-VLA
Evaluation results
| Method | Links | |
|---|---|---|
| SKG-VLABackbone=Qwen2.5-3B, Variant=mm-our2026.05 | 88.41 | |
| Qwen2.5 (sft)Backbone=Qwen2.5-3B, Variant=sft2026.05 | 87.96 | |
| Qwen2.5 (pre)Backbone=Qwen2.5-3B, Variant=pre2026.05 | 87.33 | |
| SKG-VLABackbone=Qwen2.5-1.5B, Variant=mm-our2026.05 | 87.09 | |
| Qwen2.5 (sft)Backbone=Qwen2.5-1.5B, Variant=sft2026.05 | 86.42 | |
| Qwen2.5-VL-3B-InstructBackbone=Qwen2.5-3B, Variant=Qwen2.5-VL-3B-Instruct2026.05 | 86.41 | |
| Qwen2.5 (pre)Backbone=Qwen2.5-1.5B, Variant=pre2026.05 | 85.94 | |
| Qwen2.5 (llm)Backbone=Qwen2.5-3B, Variant=llm2026.05 | 85.21 | |
| SKG-VLABackbone=Qwen2.5-0.5B, Variant=mm-our2026.05 | 83.94 | |
| Qwen2.5 (llm)Backbone=Qwen2.5-1.5B, Variant=llm2026.05 | 83.67 | |
| Qwen2.5 (sft)Backbone=Qwen2.5-0.5B, Variant=sft2026.05 | 83.18 | |
| Qwen2.5 (pre)Backbone=Qwen2.5-0.5B, Variant=pre2026.05 | 82.37 | |
| Qwen2.5 (llm)Backbone=Qwen2.5-0.5B, Variant=llm2026.05 | 79.42 |