Style Alignment on Thomas Hardy (test)
0.819Style Score (Mean)FT-Model
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FT-ModelModel=GRPO fine-tuned 8B story generator2025.12 | 0.819 | 0.102 | |
| FT-AgenticEvaluation Protocol=Few-shot calibrated, Number of Parameters=8B2025.12 | 0.809 | — | |
| GPT-oss-120BEvaluation Protocol=Few-shot calibrated, Number of Parameters=120B2025.12 | 0.551 | — | |
| GPT-oss-120BModel=Reference model, Evaluation protocol=Zero-shot2025.12 | 0.511 | 0.121 | |
| Gemma3-27BModel=Open-weight baseline, Evaluation protocol=Zero-shot2025.12 | 0.337 | 0.11 | |
| Gemma3-27BEvaluation Protocol=Few-shot calibrated, Number of Parameters=27B2025.12 | 0.29 | — | |
| Llama3-70BModel=Open-weight baseline, Evaluation protocol=Zero-shot2025.12 | 0.282 | 0.088 | |
| Llama3.3-70BEvaluation Protocol=Few-shot calibrated, Number of Parameters=70B2025.12 | 0.282 | — | |
| Qwen2.5-32BModel=Open-weight baseline, Evaluation protocol=Zero-shot2025.12 | 0.275 | 0.091 | |
| Qwen2.5-32BEvaluation Protocol=Few-shot calibrated, Number of Parameters=32B2025.12 | 0.257 | — |