List your company
ResearchFormerly WizWand

Question Answering on ARC-Challenge (ARC-C) (test)

53.7VWRSMART
25.370432.725240.0847.4348May 9, 2026
Updated 6mo ago

Evaluation results

MethodLinks
SMARTBackbone=Qwen-0.5B, Plug-in=None, Safety buffer gamma=0.252026.0553.746.8522.0452
SMARTBackbone=Mistral-7B, Plug-in=None, Safety buffer gamma=0.252026.0552.4441.8826.6768.67
R3FBackbone=Qwen-0.5B, Plug-in=None, Safety buffer gamma=0.252026.0549.684526.452.13
CEBackbone=Qwen-0.5B, Plug-in=None, Safety buffer gamma=0.252026.0549.6445.0626.452.33
CE+augBackbone=Qwen-0.5B, Plug-in=None, Safety buffer gamma=0.252026.0548.0743.3438.5854.2
SMARTBackbone=Mistral-7B, Plug-in=FragileFlow, Safety buffer gamma=0.252026.0543.636.1136.0971.73
R3FBackbone=Qwen-0.5B, Plug-in=FragileFlow, Safety buffer gamma=0.252026.0539.4535.6428.0953.93
CE+augBackbone=Qwen-0.5B, Plug-in=FragileFlow, Safety buffer gamma=0.252026.0538.4634.2638.3153.87
SMARTBackbone=Qwen-0.5B, Plug-in=FragileFlow, Safety buffer gamma=0.252026.0536.8334.1127.7353.13
CE+augBackbone=Mistral-7B, Plug-in=None, Safety buffer gamma=0.252026.0532.9128.0961.1875.8
SMARTBackbone=Qwen-1.5B, Plug-in=None, Safety buffer gamma=0.252026.0531.6127.4950.1875
CEBackbone=Mistral-7B, Plug-in=None, Safety buffer gamma=0.252026.0531.4127.1352.1875.33
R3FBackbone=Mistral-7B, Plug-in=None, Safety buffer gamma=0.252026.0531.3226.9950.7375.2
R3FBackbone=Mistral-7B, Plug-in=FragileFlow, Safety buffer gamma=0.252026.0530.9925.851.275.07
R3FBackbone=Qwen-1.5B, Plug-in=None, Safety buffer gamma=0.252026.0530.9527.8547.8974.33
CEBackbone=Qwen-1.5B, Plug-in=None, Safety buffer gamma=0.252026.0530.8727.8348.9874.13
CE+augBackbone=Qwen-1.5B, Plug-in=None, Safety buffer gamma=0.252026.0530.3426.363.8476.2
CE+augBackbone=Mistral-7B, Plug-in=FragileFlow, Safety buffer gamma=0.252026.0529.625.9665.9676.93
SMARTBackbone=Qwen-1.5B, Plug-in=FragileFlow, Safety buffer gamma=0.252026.0529.0925.452.7174.93
R3FBackbone=Qwen-1.5B, Plug-in=FragileFlow, Safety buffer gamma=0.252026.0528.4326.3348.874.2
CE+augBackbone=Qwen-1.5B, Plug-in=FragileFlow, Safety buffer gamma=0.252026.0526.4623.7768.6276.93