List your company
ResearchFormerly WizWand

Knowledge on MMB

61.98AccuracyTAIA
26.276835.545944.81554.0841May 30, 2024
Updated 8mo ago

Evaluation results

MethodLinks
TAIAModel=Qwen1.5-32B, Infer Mode=TAIA2024.0561.98
BaseModel=Qwen1.5-32B, Infer Mode=Base2024.0561.04
LoRAModel=Qwen1.5-32B, Infer Mode=LoRA2024.0559.54
TAIAModel=Qwen1.5-14B, Infer Mode=TAIA2024.0552.55
BaseModel=Qwen1.5-14B, Infer Mode=Base2024.0551.06
LoRAModel=Qwen1.5-14B, Infer Mode=LoRA2024.0548.15
TAIAModel=Qwen1.5-7B, Infer Mode=TAIA2024.0546.9
BaseModel=Qwen1.5-7B, Infer Mode=Base2024.0545.09
LoRAModel=Qwen1.5-7B, Infer Mode=LoRA2024.0544.85
LoRACLTraining Dataset=Alpaca-GPT4, Infer Mode=LORACL2024.0535.27
L2Training Dataset=Alpaca-GPT4, Infer Mode=L22024.0535.04
Self-DistillTraining Dataset=Alpaca-GPT4, Infer Mode=Self-Distill2024.0535.04
EWCTraining Dataset=Alpaca-GPT4, Infer Mode=EWC2024.0534.88
VanillaTraining Dataset=Alpaca-GPT4, Infer Mode=Vanilla2024.0534.8
TAIATraining Dataset=Alpaca-GPT4, Infer Mode=TAIA2024.0534.64
TAIATraining Dataset=CoT-Collection, Infer Mode=TAIA2024.0534.64
VanillaTraining Dataset=Base Model, Infer Mode=Vanilla2024.0533.78
L2Training Dataset=CoT-Collection, Infer Mode=L22024.0527.73
EWCTraining Dataset=CoT-Collection, Infer Mode=EWC2024.0527.73
VanillaTraining Dataset=CoT-Collection, Infer Mode=Vanilla2024.0527.65
LoRACLTraining Dataset=CoT-Collection, Infer Mode=LORACL2024.0527.65