List your company

Reward Modeling on HREF

75.95Accuracygpt-5-2025-08-07
54.026859.718465.4171.1016Jan 12, 2026

Evaluation results

MethodLinks
gpt-5-2025-08-07Model Category=Base Models (LLM-as-a-Judge)2026.0175.95
claude-3-7-sonnet-20250219Model Category=Base Models (LLM-as-a-Judge)2026.0173.84
INF-ORM-Llama3.1-70BModel Category=Scalar Reward Models, Backbone=Llama-3.1-70B2026.0173.64
URM-LLaMa-3.1-8BModel Category=Scalar Reward Models, Backbone=Llama-3.1-8B2026.0173.47
Skywork-Reward-Llama-3.1-8B-v0.2Model Category=Scalar Reward Models, Backbone=Llama-3.1-8B2026.0173.47
ArmoRM-Llama3-8B-v0.1Model Category=Scalar Reward Models, Backbone=Llama3-8B2026.0173.22
RRM-Qwen-32BModel Category=Specialized Generative Reward Models, Backbone=Qwen-32B2026.0172.73
RM-NLHF-Qwen-32BModel Category=Our Generative Reward Models, Backbone=Qwen-32B2026.0171.65
RM-R1-Qwen-32BModel Category=Specialized Generative Reward Models, Backbone=Qwen-32B2026.0170.99
o3-2025-04-16Model Category=Base Models (LLM-as-a-Judge)2026.0170.58
R1-Distill-Qwen-32BModel Category=Base Models (LLM-as-a-Judge), Backbone=Qwen-32B2026.0169.67
gemini-2.5-proModel Category=Base Models (LLM-as-a-Judge)2026.0169.34
RM-NLHF-Qwen-7BModel Category=Our Generative Reward Models, Backbone=Qwen-7B2026.0169.26
RRM-Qwen-7BModel Category=Specialized Generative Reward Models, Backbone=Qwen-7B2026.0167.77
RM-R1-Qwen-7BModel Category=Specialized Generative Reward Models, Backbone=Qwen-7B2026.0165.04
deepseek-r1-0528Model Category=Base Models (LLM-as-a-Judge)2026.0164.96
qwen-plus-latestModel Category=Base Models (LLM-as-a-Judge)2026.0164.88
qwen3-maxModel Category=Base Models (LLM-as-a-Judge)2026.0162.19
R1-Distill-Llama-8BModel Category=Base Models (LLM-as-a-Judge), Backbone=Llama-8B2026.0158.99
gpt-4o-latestModel Category=Base Models (LLM-as-a-Judge)2026.0157.77
deepseek-v3Model Category=Base Models (LLM-as-a-Judge)2026.0156.78
DeepSeek-R1-Distill-Qwen-7BModel Category=Base Models (LLM-as-a-Judge), Backbone=Qwen-7B2026.0154.87