Open-ended Generation on Creative Writing Evaluation Prompts
8.12Average Judge ScoreMin-p
Evaluation Results
| Method | Links | |
|---|---|---|
| Min-pModel=Phi, Temperature (T)=1.5, Prompt ID=Prompt 1, beta=2.82026.02 | 8.12 | |
| Min-pModel=Phi, Temperature (T)=2, Prompt ID=Prompt 3, beta=2.82026.02 | 7.92 | |
| Top-pModel=Phi, Temperature (T)=1, Prompt ID=Prompt 1, beta=2.82026.02 | 7.88 | |
| Min-pModel=Llama, Temperature (T)=1.5, Prompt ID=Prompt 1, beta=2.82026.02 | 7.88 | |
| Top-pModel=Llama, Temperature (T)=1, Prompt ID=Prompt 3, beta=2.82026.02 | 7.8 | |
| Min-pModel=Llama, Temperature (T)=1.5, Prompt ID=Prompt 2, beta=2.82026.02 | 7.8 | |
| Top-HModel=Phi, Temperature (T)=1.5, Prompt ID=Prompt 1, beta=2.82026.02 | 7.8 | |
| Top-WModel=Phi, Temperature (T)=1.5, Prompt ID=Prompt 3, beta=2.82026.02 | 7.8 | |
| Min-pModel=Phi, Temperature (T)=1.5, Prompt ID=Prompt 2, beta=2.82026.02 | 7.76 | |
| Min-pModel=Phi, Temperature (T)=2, Prompt ID=Prompt 2, beta=2.82026.02 | 7.76 | |
| Top-pModel=Phi, Temperature (T)=1, Prompt ID=Prompt 2, beta=2.82026.02 | 7.72 | |
| Top-WModel=Llama, Temperature (T)=2, Prompt ID=Prompt 3, beta=2.82026.02 | 7.72 | |
| Top-WModel=Llama, Temperature (T)=1.5, Prompt ID=Prompt 1, beta=2.82026.02 | 7.68 | |
| Top-WModel=Llama, Temperature (T)=2, Prompt ID=Prompt 1, beta=2.82026.02 | 7.64 | |
| Top-WModel=Llama, Temperature (T)=2, Prompt ID=Prompt 2, beta=2.82026.02 | 7.64 | |
| Min-pModel=Qwen, Temperature (T)=1.5, Prompt ID=Prompt 2, beta=2.82026.02 | 7.6 | |
| Top-HModel=Llama, Temperature (T)=1.5, Prompt ID=Prompt 2, beta=2.82026.02 | 7.6 | |
| Top-HModel=Llama, Temperature (T)=1.5, Prompt ID=Prompt 3, beta=2.82026.02 | 7.6 | |
| Top-HModel=Phi, Temperature (T)=1.5, Prompt ID=Prompt 2, beta=2.82026.02 | 7.6 | |
| Top-WModel=Qwen, Temperature (T)=2, Prompt ID=Prompt 3, beta=2.82026.02 | 7.6 | |
| Top-HModel=Llama, Temperature (T)=1.5, Prompt ID=Prompt 1, beta=2.82026.02 | 7.52 | |
| Min-pModel=Llama, Temperature (T)=1.5, Prompt ID=Prompt 3, beta=2.82026.02 | 7.52 | |
| Top-HModel=Phi, Temperature (T)=2, Prompt ID=Prompt 1, beta=2.82026.02 | 7.48 | |
| Top-WModel=Llama, Temperature (T)=1.5, Prompt ID=Prompt 2, beta=2.82026.02 | 7.45 | |
| Top-HModel=Llama, Temperature (T)=1, Prompt ID=Prompt 3, beta=2.82026.02 | 7.44 | |
| Top-HModel=Llama, Temperature (T)=1, Prompt ID=Prompt 1, beta=2.82026.02 | 7.4 | |
| Top-WModel=Phi, Temperature (T)=2, Prompt ID=Prompt 3, beta=2.82026.02 | 7.4 | |
| Top-HModel=Llama, Temperature (T)=1, Prompt ID=Prompt 2, beta=2.82026.02 | 7.36 | |
| Top-pModel=Phi, Temperature (T)=1, Prompt ID=Prompt 3, beta=2.82026.02 | 7.36 | |
| Top-WModel=Qwen, Temperature (T)=1, Prompt ID=Prompt 1, beta=2.82026.02 | 7.32 | |
| Top-WModel=Phi, Temperature (T)=1.5, Prompt ID=Prompt 2, beta=2.82026.02 | 7.32 | |
| Top-HModel=Phi, Temperature (T)=1, Prompt ID=Prompt 2, beta=2.82026.02 | 7.28 | |
| Min-pModel=Phi, Temperature (T)=1, Prompt ID=Prompt 3, beta=2.82026.02 | 7.28 | |
| Top-pModel=Llama, Temperature (T)=1, Prompt ID=Prompt 2, beta=2.82026.02 | 7.2 | |
| Min-pModel=Llama, Temperature (T)=1, Prompt ID=Prompt 2, beta=2.82026.02 | 7.16 | |
| Top-WModel=Qwen, Temperature (T)=1.5, Prompt ID=Prompt 1, beta=2.82026.02 | 7.16 | |
| Top-WModel=Qwen, Temperature (T)=2, Prompt ID=Prompt 1, beta=2.82026.02 | 7.16 | |
| Top-WModel=Qwen, Temperature (T)=1, Prompt ID=Prompt 2, beta=2.82026.02 | 7.12 | |
| Top-pModel=Qwen, Temperature (T)=1, Prompt ID=Prompt 3, beta=2.82026.02 | 7.12 | |
| Min-pModel=Llama, Temperature (T)=1, Prompt ID=Prompt 1, beta=2.82026.02 | 7.12 | |
| Top-pModel=Llama, Temperature (T)=1, Prompt ID=Prompt 1, beta=2.82026.02 | 7.12 | |
| Top-HModel=Phi, Temperature (T)=1, Prompt ID=Prompt 3, beta=2.82026.02 | 7.12 | |
| Top-WModel=Phi, Temperature (T)=1, Prompt ID=Prompt 3, beta=2.82026.02 | 7.12 | |
| Min-pModel=Phi, Temperature (T)=1.5, Prompt ID=Prompt 3, beta=2.82026.02 | 7.12 | |
| Top-WModel=Phi, Temperature (T)=2, Prompt ID=Prompt 2, beta=2.82026.02 | 7.12 | |
| Top-HModel=Qwen, Temperature (T)=1, Prompt ID=Prompt 3, beta=2.82026.02 | 7.1 | |
| Top-WModel=Llama, Temperature (T)=1, Prompt ID=Prompt 1, beta=2.82026.02 | 7.08 | |
| Top-HModel=Phi, Temperature (T)=1.5, Prompt ID=Prompt 3, beta=2.82026.02 | 7.08 | |
| Min-pModel=Phi, Temperature (T)=2, Prompt ID=Prompt 1, beta=2.82026.02 | 7.08 | |
| Top-WModel=Phi, Temperature (T)=2, Prompt ID=Prompt 1, beta=2.82026.02 | 7.08 | |
| Top-HModel=Qwen, Temperature (T)=1.5, Prompt ID=Prompt 3, beta=2.82026.02 | 7.04 | |
| Top-pModel=Qwen, Temperature (T)=1, Prompt ID=Prompt 2, beta=2.82026.02 | 7 | |
| Min-pModel=Phi, Temperature (T)=1, Prompt ID=Prompt 1, beta=2.82026.02 | 6.96 | |
| Top-WModel=Llama, Temperature (T)=1, Prompt ID=Prompt 2, beta=2.82026.02 | 6.95 | |
| Min-pModel=Llama, Temperature (T)=1, Prompt ID=Prompt 3, beta=2.82026.02 | 6.95 | |
| Min-pModel=Phi, Temperature (T)=1, Prompt ID=Prompt 2, beta=2.82026.02 | 6.92 | |
| Min-pModel=Qwen, Temperature (T)=1.5, Prompt ID=Prompt 3, beta=2.82026.02 | 6.92 | |
| Min-pModel=Llama, Temperature (T)=2, Prompt ID=Prompt 1, beta=2.82026.02 | 6.92 | |
| Top-WModel=Phi, Temperature (T)=1, Prompt ID=Prompt 1, beta=2.82026.02 | 6.88 | |
| Top-WModel=Qwen, Temperature (T)=1.5, Prompt ID=Prompt 3, beta=2.82026.02 | 6.88 | |
| Top-WModel=Llama, Temperature (T)=1, Prompt ID=Prompt 3, beta=2.82026.02 | 6.87 | |
| Top-HModel=Phi, Temperature (T)=1, Prompt ID=Prompt 1, beta=2.82026.02 | 6.85 | |
| Min-pModel=Qwen, Temperature (T)=2, Prompt ID=Prompt 2, beta=2.82026.02 | 6.72 | |
| Top-WModel=Llama, Temperature (T)=1.5, Prompt ID=Prompt 3, beta=2.82026.02 | 6.68 | |
| Min-pModel=Qwen, Temperature (T)=1, Prompt ID=Prompt 1, beta=2.82026.02 | 6.64 | |
| Min-pModel=Qwen, Temperature (T)=1, Prompt ID=Prompt 2, beta=2.82026.02 | 6.64 | |
| Min-pModel=Qwen, Temperature (T)=1, Prompt ID=Prompt 3, beta=2.82026.02 | 6.64 | |
| Top-HModel=Phi, Temperature (T)=2, Prompt ID=Prompt 3, beta=2.82026.02 | 6.64 | |
| Top-HModel=Qwen, Temperature (T)=1.5, Prompt ID=Prompt 2, beta=2.82026.02 | 6.56 | |
| Top-HModel=Qwen, Temperature (T)=1, Prompt ID=Prompt 2, beta=2.82026.02 | 6.52 | |
| Top-HModel=Qwen, Temperature (T)=1, Prompt ID=Prompt 1, beta=2.82026.02 | 6.45 | |
| Top-WModel=Phi, Temperature (T)=1.5, Prompt ID=Prompt 1, beta=2.82026.02 | 6.44 | |
| Top-HModel=Phi, Temperature (T)=2, Prompt ID=Prompt 2, beta=2.82026.02 | 6.44 | |
| Top-HModel=Llama, Temperature (T)=2, Prompt ID=Prompt 1, beta=2.82026.02 | 6.2 | |
| Top-pModel=Qwen, Temperature (T)=1, Prompt ID=Prompt 1, beta=2.82026.02 | 6.16 | |
| Top-WModel=Qwen, Temperature (T)=2, Prompt ID=Prompt 2, beta=2.82026.02 | 6.15 | |
| Top-WModel=Phi, Temperature (T)=1, Prompt ID=Prompt 2, beta=2.82026.02 | 6.12 | |
| Top-WModel=Qwen, Temperature (T)=1.5, Prompt ID=Prompt 2, beta=2.82026.02 | 6 | |
| Min-pModel=Qwen, Temperature (T)=1.5, Prompt ID=Prompt 1, beta=2.82026.02 | 5.96 | |
| Min-pModel=Qwen, Temperature (T)=2, Prompt ID=Prompt 3, beta=2.82026.02 | 5.92 | |
| Min-pModel=Llama, Temperature (T)=2, Prompt ID=Prompt 2, beta=2.82026.02 | 5.75 | |
| Min-pModel=Qwen, Temperature (T)=2, Prompt ID=Prompt 1, beta=2.82026.02 | 5.6 | |
| Top-WModel=Qwen, Temperature (T)=1, Prompt ID=Prompt 3, beta=2.82026.02 | 5.56 | |
| Top-pModel=Phi, Temperature (T)=1.5, Prompt ID=Prompt 1, beta=2.82026.02 | 5.2 | |
| Top-HModel=Qwen, Temperature (T)=1.5, Prompt ID=Prompt 1, beta=2.82026.02 | 5 | |
| Min-pModel=Llama, Temperature (T)=2, Prompt ID=Prompt 3, beta=2.82026.02 | 4.8 | |
| Top-HModel=Qwen, Temperature (T)=2, Prompt ID=Prompt 1, beta=2.82026.02 | 4.64 | |
| Top-pModel=Phi, Temperature (T)=1.5, Prompt ID=Prompt 2, beta=2.82026.02 | 4.48 | |
| Top-HModel=Qwen, Temperature (T)=2, Prompt ID=Prompt 2, beta=2.82026.02 | 4.4 | |
| Top-HModel=Llama, Temperature (T)=2, Prompt ID=Prompt 2, beta=2.82026.02 | 4.4 | |
| Top-HModel=Llama, Temperature (T)=2, Prompt ID=Prompt 3, beta=2.82026.02 | 4.04 | |
| Top-pModel=Llama, Temperature (T)=1.5, Prompt ID=Prompt 1, beta=2.82026.02 | 3.84 | |
| Top-HModel=Qwen, Temperature (T)=2, Prompt ID=Prompt 3, beta=2.82026.02 | 3.68 | |
| Top-pModel=Phi, Temperature (T)=1.5, Prompt ID=Prompt 3, beta=2.82026.02 | 3.56 | |
| Top-pModel=Llama, Temperature (T)=2, Prompt ID=Prompt 1, beta=2.82026.02 | 2.4 | |
| Top-pModel=Llama, Temperature (T)=2, Prompt ID=Prompt 2, beta=2.82026.02 | 2.2 | |
| Top-pModel=Phi, Temperature (T)=2, Prompt ID=Prompt 1, beta=2.82026.02 | 2.2 | |
| Top-pModel=Llama, Temperature (T)=1.5, Prompt ID=Prompt 2, beta=2.82026.02 | 2.16 | |
| Top-pModel=Phi, Temperature (T)=2, Prompt ID=Prompt 2, beta=2.82026.02 | 2.08 | |
| Top-pModel=Qwen, Temperature (T)=2, Prompt ID=Prompt 2, beta=2.82026.02 | 2.04 |