List your company
ResearchFormerly WizWand

Ethical Reasoning on ETHICS (test)

86AccuracyMultiRole-R1
49.423258.919168.41577.9109Jul 27, 2025
Updated 8mo ago

Evaluation results

MethodLinks
MultiRole-R1Backbone=R1-Distill-Qwen-14B, Method Strategy=SelfConsis SFT+GRPO(RS)2025.078692.89
SelfConsis SFT+GRPOBackbone=R1-Distill-Qwen-14B2025.0783.589.42
MultiRole-R1Backbone=Qwen3-8B, Method Strategy=SelfConsis SFT+GRPO(RS)2025.0781.9589.09
SelfConsis SFT+DPOBackbone=R1-Distill-Qwen-14B2025.0781.8842.32
SelfConsis SFTBackbone=R1-Distill-Qwen-14B2025.0781.4571.34
SelfConsis SFT+GRPOBackbone=Qwen3-8B2025.0779.8286.84
More thinkBackbone=R1-Distill-Qwen-14B2025.0779.3683.33
SelfConsis SFTBackbone=Qwen3-8B2025.0778.3968.35
More thinkBackbone=Qwen3-8B2025.0778.2672.45
SelfConsis SFT+DPOBackbone=Qwen3-8B2025.0778.0950.31
Role-PlayBackbone=R1-Distill-Qwen-14B2025.0777.1675.3
Self-RefineBackbone=R1-Distill-Qwen-14B2025.0776.4883.22
MultiRole-R1Backbone=R1-Distill-Llama-8B, Method Strategy=SelfConsis SFT+GRPO(RS)2025.0775.8496.54
SelfConsis SFT+GRPOBackbone=R1-Distill-Llama-8B2025.0775.6387.89
Zero-shot CoTBackbone=R1-Distill-Qwen-14B2025.0773.6372.2
Zero-shot CoTBackbone=Qwen3-8B2025.0772.2976.68
SelfConsis SFT+DPOBackbone=R1-Distill-Llama-8B2025.0771.2283.64
Role-PlayBackbone=Qwen3-8B2025.0770.6747.83
Self-RefineBackbone=Qwen3-8B2025.0770.6449.6
SelfConsis SFTBackbone=R1-Distill-Llama-8B2025.0770.5681.36
SelfConsis SFT+GRPOBackbone=R1-Distill-Qwen-7B2025.0769.585.4
More thinkBackbone=R1-Distill-Llama-8B2025.0768.0683.99
SelfConsis SFTBackbone=R1-Distill-Qwen-7B2025.0767.4582.19
SelfConsis SFT+DPOBackbone=R1-Distill-Qwen-7B2025.0767.2868.51
MultiRole-R1Backbone=R1-Distill-Qwen-7B, Method Strategy=SelfConsis SFT+GRPO(RS)2025.0766.8387.27
More thinkBackbone=R1-Distill-Qwen-7B2025.0764.4481.53
Role-PlayBackbone=R1-Distill-Llama-8B2025.0764.2479.78
Zero-shot CoTBackbone=R1-Distill-Llama-8B2025.0762.4679.44
Self-RefineBackbone=R1-Distill-Llama-8B2025.0760.9680.17
Self-RefineBackbone=R1-Distill-Qwen-7B2025.0752.1937.36
Zero-shot CoTBackbone=R1-Distill-Qwen-7B2025.0751.8236.14
Role-PlayBackbone=R1-Distill-Qwen-7B2025.0750.8337.89