List your company
ResearchFormerly WizWand

Reasoning on BBQ (test)

97.5Accuracy (Reasoning BBQ)MultiRole-R1
61.04870.511579.97589.4385Jul 27, 2025
Updated 8mo ago

Evaluation results

MethodLinks
MultiRole-R1Backbone=R1-Distill-Qwen-14B, Method Strategy=SelfConsis SFT+GRPO(RS)2025.0797.590.17
MultiRole-R1Backbone=Qwen3-8B, Method Strategy=SelfConsis SFT+GRPO(RS)2025.0796.9888.15
SelfConsis SFT+GRPOBackbone=R1-Distill-Qwen-14B2025.0795.9886.88
SelfConsis SFT+GRPOBackbone=Qwen3-8B2025.0795.9185.47
MultiRole-R1Backbone=R1-Distill-Llama-8B, Method Strategy=SelfConsis SFT+GRPO(RS)2025.0795.5589.58
More thinkBackbone=Qwen3-8B2025.0795.1874.2
SelfConsis SFT+DPOBackbone=R1-Distill-Qwen-14B2025.0794.9867.21
More thinkBackbone=R1-Distill-Qwen-14B2025.0794.5780.67
MultiRole-R1Backbone=R1-Distill-Qwen-7B, Method Strategy=SelfConsis SFT+GRPO(RS)2025.0794.586.25
SelfConsis SFT+GRPOBackbone=R1-Distill-Llama-8B2025.0794.4785.75
SelfConsis SFTBackbone=R1-Distill-Qwen-14B2025.0794.475.06
SelfConsis SFT+GRPOBackbone=R1-Distill-Qwen-7B2025.0794.385.52
SelfConsis SFT+DPOBackbone=Qwen3-8B2025.0794.2174.83
SelfConsis SFTBackbone=Qwen3-8B2025.0794.0574.02
Zero-shot CoTBackbone=Qwen3-8B2025.0791.7170.1
Role-PlayBackbone=R1-Distill-Qwen-14B2025.0791.1881.87
SelfConsis SFT+DPOBackbone=R1-Distill-Llama-8B2025.0790.5280.43
Self-RefineBackbone=R1-Distill-Qwen-14B2025.0790.4280.13
Role-PlayBackbone=Qwen3-8B2025.0789.7741.58
SelfConsis SFTBackbone=R1-Distill-Llama-8B2025.0789.6982.64
Self-RefineBackbone=Qwen3-8B2025.0788.9353.07
More thinkBackbone=R1-Distill-Llama-8B2025.0788.284.11
SelfConsis SFT+DPOBackbone=R1-Distill-Qwen-7B2025.0786.4160.43
SelfConsis SFTBackbone=R1-Distill-Qwen-7B2025.0785.8881.67
Zero-shot CoTBackbone=R1-Distill-Qwen-14B2025.0785.0168.06
Zero-shot CoTBackbone=R1-Distill-Llama-8B2025.0780.8979.92
More thinkBackbone=R1-Distill-Qwen-7B2025.0780.7680.44
Role-PlayBackbone=R1-Distill-Llama-8B2025.0774.480.91
Self-RefineBackbone=R1-Distill-Llama-8B2025.0774.275.85
Self-RefineBackbone=R1-Distill-Qwen-7B2025.0774.0873.13
Role-PlayBackbone=R1-Distill-Qwen-7B2025.0773.6174.68
Zero-shot CoTBackbone=R1-Distill-Qwen-7B2025.0762.4556.02