Story Generation Diversity Analysis on Speculative Model Card Task
5.863Distinct-2 ScoreStorytelling
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| StorytellingModel=Gemma2025.10 | 5.863 | 6.042 | 6.062 | 6.065 | 95.5 | 159 | |
| StorytellingModel=Llama32025.10 | 5.84 | 6.104 | 6.158 | 6.174 | 93.7 | 179 | |
| BaselineModel=Gemma2025.10 | 5.837 | 5.939 | 5.946 | 5.946 | 97.9 | 141 | |
| w/o Role-PlayingModel=Gemma2025.10 | 5.834 | 5.935 | 5.942 | 5.943 | 97.7 | 141 | |
| w/o Environment TrajectoriesModel=Llama32025.10 | 5.745 | 5.98 | 6.025 | 6.036 | 95.3 | 155 | |
| w/o Environment TrajectoriesModel=Gemma2025.10 | 5.734 | 5.861 | 5.873 | 5.873 | 97.8 | 131 | |
| BaselineModel=Llama32025.10 | 5.728 | 5.82 | 5.951 | 5.961 | 93.4 | 175 | |
| w/o Role-PlayingModel=Llama32025.10 | 5.722 | 5.819 | 5.849 | 5.858 | 93.6 | 175 | |
| w/o Role-PlayingModel=GPT4o2025.10 | 5.698 | 5.789 | 5.794 | 5.794 | 98.8 | 121 | |
| StorytellingModel=GPT4o2025.10 | 5.696 | 5.818 | 5.824 | 5.825 | 97.8 | 125 | |
| BaselineModel=GPT4o2025.10 | 5.692 | 5.794 | 5.798 | 5.799 | 98.4 | 122 | |
| w/o Environment TrajectoriesModel=GPT4o2025.10 | 5.585 | 5.687 | 5.693 | 5.693 | 97.4 | 110 |