Creative Writing on Creative Writing (Win-Rate Metrics)
70.1Win Rate vs ConfidenceInfo-Gain Sampler
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Info-Gain SamplerTemperature=1.5, K=22026.02 | 70.1 | 80.3 | 66.8 | |
| Info-Gain SamplerTemperature=0.5, K=22026.02 | 68.9 | 70.4 | 64.7 | |
| Info-Gain SamplerTemperature=0.5, K=12026.02 | 65.8 | 59.1 | 63.6 | |
| Info-Gain SamplerTemperature=1.0, K=22026.02 | 61.1 | 65.7 | 57.5 | |
| Info-Gain SamplerTemperature=1.0, K=12026.02 | 57.7 | 60.1 | 55.2 | |
| Info-Gain SamplerTemperature=1.5, K=12026.02 | 53 | 60.3 | 54.6 |