List your company

Reward Modeling on RewardBench Chat-Hard

89.4Chat-Hard ScoreSKYWORK-RM (w/ calibration)
56.53665.06873.682.132Apr 14, 2025

Evaluation results

MethodLinks
SKYWORK-RM (w/ calibration)Mismatch Degree=0.639, Calibration setting=w/ calibration2025.0489.4
SKYWORK-RMMismatch Degree=0.639, Calibration setting=Original2025.0488.8
SKYWORK-RM (w/o calibration)Mismatch Degree=0.639, Calibration setting=w/o calibration2025.0488.8
GRM-RM (w/ calibration)Mismatch Degree=0.508, Calibration setting=w/ calibration2025.0468.9
GRM-RM (w/o calibration)Mismatch Degree=0.508, Calibration setting=w/o calibration2025.0468.8
GRM-RMMismatch Degree=0.508, Calibration setting=Original2025.0468.4
FSFAIRX-RM (w/ calibration)Mismatch Degree=0.554, Calibration setting=w/ calibration2025.0465.7
FSFAIRX-RMMismatch Degree=0.554, Calibration setting=Original2025.0465.3
FSFAIRX-RM (w/o calibration)Mismatch Degree=0.554, Calibration setting=w/o calibration2025.0465.1
MISTRAL-RM (w/ calibration)Mismatch Degree=0.528, Calibration setting=w/ calibration2025.0465.1
MISTRAL-RM (w/o calibration)Mismatch Degree=0.528, Calibration setting=w/o calibration2025.0462.5
MISTRAL-RMMismatch Degree=0.528, Calibration setting=Original2025.0460.5
BTRM-RM (w/o calibration)Mismatch Degree=0.162, Calibration setting=w/o calibration2025.0458.7
BTRM-RMMismatch Degree=0.162, Calibration setting=Original2025.0458.1
BTRM-RM (w/ calibration)Mismatch Degree=0.162, Calibration setting=w/ calibration2025.0457.8