Reward Aggregation on PLawBench
78.4ScoreRuscaRL + GEAR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RuscaRL + GEARPolicy Model=Llama-3.1-8B-Instruct, Pipeline Category=Plug-in replacement in rubric-guided RL pipelines2026.06 | 78.4 | 4.2 | |
| RuscaRL + GEARPolicy Model=Qwen2.5-7B-Instruct, Pipeline Category=Plug-in replacement in rubric-guided RL pipelines2026.06 | 76.9 | 4.8 | |
| GEARPolicy Model=Llama-3.1-8B-Instruct, Pipeline Category=Aggregation-only2026.06 | 76.9 | 7.4 | |
| GEARPolicy Model=Qwen2.5-7B-Instruct, Pipeline Category=Aggregation-only2026.06 | 75.2 | 6.8 | |
| RuscaRLPolicy Model=Llama-3.1-8B-Instruct, Pipeline Category=Plug-in replacement in rubric-guided RL pipelines2026.06 | 74.2 | — | |
| RuscaRLPolicy Model=Qwen2.5-7B-Instruct, Pipeline Category=Plug-in replacement in rubric-guided RL pipelines2026.06 | 72.1 | — | |
| RaR-Explicit + GEARPolicy Model=Llama-3.1-8B-Instruct, Pipeline Category=Plug-in replacement in rubric-guided RL pipelines2026.06 | 70.5 | 6.7 | |
| Flat aggregationPolicy Model=Llama-3.1-8B-Instruct, Pipeline Category=Aggregation-only2026.06 | 69.5 | — | |
| RaR-Explicit + GEARPolicy Model=Qwen2.5-7B-Instruct, Pipeline Category=Plug-in replacement in rubric-guided RL pipelines2026.06 | 68.8 | 6.5 | |
| Flat aggregationPolicy Model=Qwen2.5-7B-Instruct, Pipeline Category=Aggregation-only2026.06 | 68.4 | — | |
| Hard gatingPolicy Model=Llama-3.1-8B-Instruct, Pipeline Category=Aggregation-only2026.06 | 66.7 | — | |
| Hard gatingPolicy Model=Qwen2.5-7B-Instruct, Pipeline Category=Aggregation-only2026.06 | 65 | — | |
| RaR-ExplicitPolicy Model=Llama-3.1-8B-Instruct, Pipeline Category=Plug-in replacement in rubric-guided RL pipelines2026.06 | 63.8 | — | |
| RaR-ExplicitPolicy Model=Qwen2.5-7B-Instruct, Pipeline Category=Plug-in replacement in rubric-guided RL pipelines2026.06 | 62.3 | — | |
| MeRF + GEARPolicy Model=Llama-3.1-8B-Instruct, Pipeline Category=Plug-in replacement in rubric-guided RL pipelines2026.06 | 62.1 | 3.7 | |
| MeRF + GEARPolicy Model=Qwen2.5-7B-Instruct, Pipeline Category=Plug-in replacement in rubric-guided RL pipelines2026.06 | 60.4 | 4.7 | |
| MeRFPolicy Model=Llama-3.1-8B-Instruct, Pipeline Category=Plug-in replacement in rubric-guided RL pipelines2026.06 | 58.4 | — | |
| MeRFPolicy Model=Qwen2.5-7B-Instruct, Pipeline Category=Plug-in replacement in rubric-guided RL pipelines2026.06 | 55.7 | — |