List your company
ResearchFormerly WizWand

Story Evaluation on StoryER (test)

0.6774Pearson CorrelationEvolvR
0.1707120.3022560.43380.565344Aug 8, 2025
Updated 8mo ago

Evaluation results

MethodLinks
EvolvRModel Category=Story Evalution Finetune Open-source Models2025.080.67740.60.53530.052894.74
GPT-o3-0416-globalModel Category=General Closed-source Models2025.080.56820.49440.44020.047787.03
Qwen2.5-7B-Instruct + Point CoTModel Category=Story Evalution Finetune Open-source Models, Point CoT=true2025.080.56770.47840.43920.029393.44
Qwen2.5-7B-Instruct + Point CoT + GRPOModel Category=Story Evalution Finetune Open-source Models, Point CoT=true, GRPO=true2025.080.56460.48310.44720.041994.33
Gemini-2.5-Pro-06-17Model Category=General Closed-source Models2025.080.54510.52750.47960.093188.66
Themis-8BModel Category=NLG Evalution Open-Source Models2025.080.53620.3870.34840.074394.59
GPT-4oModel Category=General Closed-source Models2025.080.48080.46790.39750.039889.79
Claude-4-opus4Model Category=General Closed-source Models2025.080.47960.4060.35610.099584.4
Claude-4-SonnetModel Category=General Closed-source Models2025.080.41570.34150.30240.067686.62
Gemini-2.5-flash-06-17Model Category=General Closed-source Models2025.080.38820.30420.27010.109191.73
GPT-4.1Model Category=General Closed-source Models2025.080.36730.29080.25670.070589.98
Qwen2.5-7B-Instruct + GRPOModel Category=Story Evalution Finetune Open-source Models, GRPO=true2025.080.3430.24360.21780.084987.93
AutoJ-13BModel Category=NLG Evalution Open-Source Models2025.080.31820.18730.16310.062390.12
CokeModel Category=Story Evalution Finetune Open-source Models2025.080.3142——0.081265.09
TIGERScore-13BModel Category=NLG Evalution Open-Source Models2025.080.27590.23640.23170.145586.37
Qwen2.5-7B-InstructModel Category=Story Evalution Finetune Open-source Models2025.080.22060.16110.13810.143483.08
InstructScore-7BModel Category=NLG Evalution Open-Source Models2025.080.19020.16640.12510.130384.3