List your company
ResearchFormerly WizWand

Commonsense Reasoning on CSQA OOD (test)

82.1AccuracyMultiRole-R1
52.896860.478468.0675.6416Jul 27, 2025
Updated 8mo ago

Evaluation results

MethodLinks
MultiRole-R1Backbone=Qwen3-8B, Method Strategy=SelfConsis SFT+GRPO(RS)2025.0782.187.93
MultiRole-R1Backbone=R1-Distill-Qwen-14B, Method Strategy=SelfConsis SFT+GRPO(RS)2025.078291.61
SelfConsis SFTBackbone=R1-Distill-Qwen-14B2025.0781.577.6
More thinkBackbone=Qwen3-8B2025.0781.273.07
SelfConsis SFT+GRPOBackbone=R1-Distill-Qwen-14B2025.0781.1989.64
SelfConsis SFT+GRPOBackbone=Qwen3-8B2025.0781.1986.4
SelfConsis SFTBackbone=Qwen3-8B2025.078173.5
Zero-shot CoTBackbone=Qwen3-8B2025.0780.8157.84
SelfConsis SFT+DPOBackbone=Qwen3-8B2025.0780.4564.87
SelfConsis SFT+DPOBackbone=R1-Distill-Qwen-14B2025.0779.8269.41
More thinkBackbone=R1-Distill-Qwen-14B2025.0779.3681.77
Self-RefineBackbone=R1-Distill-Qwen-14B2025.0776.5582.31
Zero-shot CoTBackbone=R1-Distill-Qwen-14B2025.0775.8583.09
Role-PlayBackbone=R1-Distill-Qwen-14B2025.0775.7179.05
MultiRole-R1Backbone=R1-Distill-Llama-8B, Method Strategy=SelfConsis SFT+GRPO(RS)2025.0775.1292.98
SelfConsis SFT+GRPOBackbone=R1-Distill-Llama-8B2025.0773.7187.96
Role-PlayBackbone=Qwen3-8B2025.0772.9848.17
SelfConsis SFT+DPOBackbone=R1-Distill-Llama-8B2025.0771.2882.71
SelfConsis SFTBackbone=R1-Distill-Llama-8B2025.0770.8683.88
More thinkBackbone=R1-Distill-Llama-8B2025.0770.4284.73
SelfConsis SFT+GRPOBackbone=R1-Distill-Qwen-7B2025.0769.4386.85
Self-RefineBackbone=Qwen3-8B2025.0769.2250.99
Role-PlayBackbone=R1-Distill-Llama-8B2025.0767.3282.27
SelfConsis SFT+DPOBackbone=R1-Distill-Qwen-7B2025.0767.2469.83
Zero-shot CoTBackbone=R1-Distill-Llama-8B2025.0767.2183.39
MultiRole-R1Backbone=R1-Distill-Qwen-7B, Method Strategy=SelfConsis SFT+GRPO(RS)2025.0766.9487.96
SelfConsis SFTBackbone=R1-Distill-Qwen-7B2025.0766.8883.1
More thinkBackbone=R1-Distill-Qwen-7B2025.0764.585.85
Self-RefineBackbone=R1-Distill-Llama-8B2025.0763.7782.61
Zero-shot CoTBackbone=R1-Distill-Qwen-7B2025.0763.0683.83
Role-PlayBackbone=R1-Distill-Qwen-7B2025.0755.0776.2
Self-RefineBackbone=R1-Distill-Qwen-7B2025.0754.0277.61