Helpful and Harmless Preference Reasoning on HH-RLHF
54.3AccuracyMajority Vote
Evaluation results
| Method | Links | |
|---|---|---|
| Majority VoteBackbone Model=Falcon3-7B, Number of Agents=4, Number of Rounds=22026.03 | 54.3 | |
| DARModel=Llama3.1-8B2026.03 | 54.2 | |
| DARBackbone Model=Llama3.1-8B, Number of Agents=4, Number of Rounds=22026.03 | 54.1 | |
| Society Of MindModel=Llama3.1-8B2026.03 | 54 | |
| Society Of MindBackbone Model=Llama3.1-8B, Number of Agents=4, Number of Rounds=22026.03 | 53.2 | |
| Majority VoteBackbone Model=Llama3.1-8B, Number of Agents=4, Number of Rounds=22026.03 | 53.2 | |
| Majority VoteModel=Falcon3-7B2026.03 | 53 | |
| Uncertain PromptModel=Llama3.1-8B2026.03 | 52.3 | |
| MAD-M2Model=Falcon3-7B2026.03 | 52.1 | |
| Uncertain PromptBackbone Model=Llama3.1-8B, Number of Agents=4, Number of Rounds=22026.03 | 52.1 | |
| Majority VoteModel=Llama3.1-8B2026.03 | 52 | |
| MAD-M^2Backbone Model=Llama3.1-8B, Number of Agents=4, Number of Rounds=22026.03 | 52 | |
| Vote PromptBackbone Model=Llama3.1-8B, Number of Agents=4, Number of Rounds=22026.03 | 52 | |
| MAD-M2Model=Llama3.1-8B2026.03 | 51.3 | |
| Vote PromptModel=Llama3.1-8B2026.03 | 51 | |
| MAD-M2Model=Qwen2.5-1.5B2026.03 | 50.9 | |
| MAD-M^2Backbone Model=Qwen2.5-1.5B, Number of Agents=4, Number of Rounds=22026.03 | 50.8 | |
| DARBackbone Model=Falcon3-7B, Number of Agents=4, Number of Rounds=22026.03 | 49.6 | |
| Single-agentBackbone Model=Llama3.1-8B2026.03 | 49.5 | |
| MAD-M^2Backbone Model=Falcon3-7B, Number of Agents=4, Number of Rounds=22026.03 | 49.4 | |
| Single-agentModel=Llama3.1-8B2026.03 | 49 | |
| DARModel=Qwen2.5-3B2026.03 | 48.3 | |
| DARBackbone Model=Qwen2.5-3B, Number of Agents=4, Number of Rounds=22026.03 | 47.7 | |
| Uncertain PromptModel=Falcon3-7B2026.03 | 47.5 | |
| DARModel=Falcon3-7B2026.03 | 47 | |
| Vote PromptModel=Falcon3-7B2026.03 | 46.5 | |
| Society Of MindModel=Qwen2.5-3B2026.03 | 46.2 | |
| Vote PromptBackbone Model=Falcon3-7B, Number of Agents=4, Number of Rounds=22026.03 | 46.2 | |
| Society Of MindBackbone Model=Qwen2.5-3B, Number of Agents=4, Number of Rounds=22026.03 | 46 | |
| Majority VoteModel=Qwen2.5-3B2026.03 | 45.7 | |
| Majority VoteBackbone Model=Qwen2.5-3B, Number of Agents=4, Number of Rounds=22026.03 | 45.4 | |
| Vote PromptModel=Qwen2.5-3B2026.03 | 45.3 | |
| Vote PromptBackbone Model=Qwen2.5-3B, Number of Agents=4, Number of Rounds=22026.03 | 44.9 | |
| Uncertain PromptBackbone Model=Falcon3-7B, Number of Agents=4, Number of Rounds=22026.03 | 44.6 | |
| Uncertain PromptModel=Qwen2.5-3B2026.03 | 44.2 | |
| Society Of MindModel=Falcon3-7B2026.03 | 43.7 | |
| Society Of MindBackbone Model=Falcon3-7B, Number of Agents=4, Number of Rounds=22026.03 | 42.2 | |
| Uncertain PromptBackbone Model=Qwen2.5-3B, Number of Agents=4, Number of Rounds=22026.03 | 40.9 | |
| MAD-M^2Backbone Model=Qwen2.5-3B, Number of Agents=4, Number of Rounds=22026.03 | 40.6 | |
| Single-agentModel=Qwen2.5-3B2026.03 | 40.2 | |
| MAD-M2Model=Qwen2.5-3B2026.03 | 39 | |
| Single-agentBackbone Model=Qwen2.5-3B2026.03 | 39 | |
| DARModel=Qwen2.5-1.5B2026.03 | 38 | |
| DARBackbone Model=Qwen2.5-1.5B, Number of Agents=4, Number of Rounds=22026.03 | 37.8 | |
| Majority VoteModel=Qwen2.5-1.5B2026.03 | 37.2 | |
| Majority VoteBackbone Model=Qwen2.5-1.5B, Number of Agents=4, Number of Rounds=22026.03 | 37.2 | |
| Single-agentModel=Falcon3-7B2026.03 | 37 | |
| Single-agentBackbone Model=Falcon3-7B2026.03 | 36.2 | |
| Vote PromptBackbone Model=Qwen2.5-1.5B, Number of Agents=4, Number of Rounds=22026.03 | 35.4 | |
| Vote PromptModel=Qwen2.5-1.5B2026.03 | 35 | |
| Society Of MindBackbone Model=Qwen2.5-1.5B, Number of Agents=4, Number of Rounds=22026.03 | 34.6 | |
| Uncertain PromptModel=Qwen2.5-1.5B2026.03 | 34 | |
| Society Of MindModel=Qwen2.5-1.5B2026.03 | 33.3 | |
| Uncertain PromptBackbone Model=Qwen2.5-1.5B, Number of Agents=4, Number of Rounds=22026.03 | 28.3 | |
| Single-agentBackbone Model=Qwen2.5-1.5B2026.03 | 28.2 | |
| Single-agentModel=Qwen2.5-1.5B2026.03 | 26 |