Creative Writing on ROCStories + WritingPrompts
63.3QD-ScoreQD-LLM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| QD-LLMBase LLM=Llama-3-70B-Instruct, Budget=5002026.05 | 63.3 | 63.1 | 52 | 28 | 96 | |
| CMA-ME (ad.)Prompt embeddings=adapted, Base LLM=Llama-3-70B-Instruct, Budget=5002026.05 | 46.2 | 46 | 39 | 38 | — | |
| QDAIFBase LLM=Llama-3-70B-Instruct, Budget=5002026.05 | 44.8 | 44.6 | 37 | 40 | — | |
| Best-of-N+MMRN=20, Base LLM=Llama-3-70B-Instruct, Budget=5002026.05 | 40.1 | 39.9 | 31 | 46 | — | |
| Diverse Beam Searchλ=0.5, Base LLM=Llama-3-70B-Instruct, Budget=5002026.05 | 38.2 | 38 | 28 | 52 | — | |
| Nucleus Samplingp=0.95, Base LLM=Llama-3-70B-Instruct, Budget=5002026.05 | 36.4 | 36.2 | 26 | 56 | — |