Story Premise Evaluation on Story Premises 100 samples 1.0 (test)
73.66FascinationSTM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| STMEvaluation Judge=Claude-3-opus, Description=Storium2024.06 | 73.66 | 67.4 | 89.65 | 76.9 | |
| MoPSEvaluation Judge=Claude-3-opus2024.06 | 73.65 | 72.35 | 94.75 | 80.25 | |
| CPXEvaluation Judge=Claude-3-opus, Description=Complex LLM-based baseline2024.06 | 71.22 | 66.4 | 84.65 | 74.09 | |
| WPEvaluation Judge=Claude-3-opus, Description=WritingPrompts2024.06 | 70.74 | 51.9 | 93.7 | 72.11 |