List your company
ResearchFormerly WizWand

Complaint Classification on CFPB-Issue

77.88Macro-F1SKG-VLA
62.59266.56170.5374.499May 10, 2026
Updated 5mo ago

Evaluation results

MethodLinks
SKG-VLABackbone=Qwen2.5-3B, Variant=mm-our2026.0577.88
Qwen2.5 (sft)Backbone=Qwen2.5-3B, Variant=sft2026.0577.2
Qwen2.5 (pre)Backbone=Qwen2.5-3B, Variant=pre2026.0576.51
SKG-VLABackbone=Qwen2.5-1.5B, Variant=mm-our2026.0575.84
Qwen2.5-VL-3B-InstructBackbone=Qwen2.5-3B, Variant=Qwen2.5-VL-3B-Instruct2026.0575.18
Qwen2.5 (sft)Backbone=Qwen2.5-1.5B, Variant=sft2026.0575.16
Qwen2.5 (pre)Backbone=Qwen2.5-1.5B, Variant=pre2026.0574.38
Qwen2.5 (llm)Backbone=Qwen2.5-3B, Variant=llm2026.0573.46
Qwen2.5 (llm)Backbone=Qwen2.5-1.5B, Variant=llm2026.0570.92
SKG-VLABackbone=Qwen2.5-0.5B, Variant=mm-our2026.0569.08
Qwen2.5 (sft)Backbone=Qwen2.5-0.5B, Variant=sft2026.0568.55
Qwen2.5 (pre)Backbone=Qwen2.5-0.5B, Variant=pre2026.0567.41
Qwen2.5 (llm)Backbone=Qwen2.5-0.5B, Variant=llm2026.0563.18