List your company

Human-Model Agreement Evaluation on Rebuttal-RM dataset 1.0 (test)

0.839Attitude (Pearson r)Rebuttal-RM
0.275320.421660.5680.71434Jan 22, 2026

Evaluation results

MethodLinks
Rebuttal-RMScoring Model=Rebuttal-RM, Base Model=Qwen3-8B2026.010.8390.828910.7530.677790.8210.801820.8390.835810.812
GPT-4.1Scoring Model=GPT-4.12026.010.7430.712800.7390.671750.7790.763740.8040.756680.745
Qwen3-8BScoring Model=Qwen3-8B2026.010.7180.672620.6090.568710.6220.577690.7180.745720.664
DeepSeek-v3Scoring Model=DeepSeek-v32026.010.6990.733710.6870.578740.6970.652770.7710.719750.692
DeepSeek-r1Scoring Model=DeepSeek-r12026.010.6460.633790.7080.615760.710.664720.7420.701620.705
Gemini-2.5Scoring Model=Gemini-2.52026.010.620.509750.6050.593540.6270.607520.7110.705610.616
Claude-3.5Scoring Model=Claude-3.52026.010.5690.635720.7040.67680.7060.686670.7530.738630.68
GLM-4-9BScoring Model=GLM-4-9B2026.010.420.475460.4670.436730.3690.361700.5610.519570.506
Llama-3.1-8BScoring Model=Llama-3.1-8B2026.010.2970.347540.1580.047380.2720.245560.4240.457460.349