Idea Generation on LiveIdeaBench
6.6OriginalitySTARS
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| STARSBackbone=LLAMA-3.2-3B-INSTRUCT, Temperature (T)=1, C=0.52026.01 | 6.6 | 5.32 | 5.85 | 5.6 | 5.71 | 5.82 | |
| STARSBackbone=LLAMA-3.2-3B-INSTRUCT, Temperature (T)=1, C=0.12026.01 | 6.57 | 5.31 | 5.89 | 5.45 | 5.68 | 5.78 | |
| STARSBackbone=LLAMA-3.2-3B-INSTRUCT, Temperature (T)=0.8, C=0.52026.01 | 6.56 | 5.36 | 5.91 | 5.22 | 5.62 | 5.73 | |
| STARSBackbone=LLAMA-3.2-3B-INSTRUCT, Temperature (T)=0.6, C=0.52026.01 | 6.53 | 5.42 | 5.97 | 4.81 | 5.58 | 5.66 | |
| SAMPLINGBackbone=LLAMA-3.2-3B-INSTRUCT, Temperature (T)=12026.01 | 6.51 | 5.34 | 5.89 | 5.41 | 5.66 | 5.76 | |
| STARSBackbone=LLAMA-3.2-3B-INSTRUCT, Temperature (T)=0.2, C=0.52026.01 | 6.51 | 5.46 | 6.02 | 4.04 | 5.39 | 5.48 | |
| STARSBackbone=LLAMA-3.2-3B-INSTRUCT, Temperature (T)=0.4, C=0.52026.01 | 6.5 | 5.44 | 5.99 | 4.41 | 5.48 | 5.56 | |
| STARSBackbone=LLAMA-3.2-3B-INSTRUCT, Temperature (T)=0.8, C=0.12026.01 | 6.49 | 5.39 | 5.92 | 5.11 | 5.59 | 5.7 | |
| SAMPLINGBackbone=LLAMA-3.2-3B-INSTRUCT, Temperature (T)=0.82026.01 | 6.47 | 5.39 | 5.92 | 5.07 | 5.58 | 5.69 | |
| STARSBackbone=LLAMA-3.2-3B-INSTRUCT, Temperature (T)=0.2, C=0.12026.01 | 6.46 | 5.48 | 6.03 | 3.6 | 5.27 | 5.37 | |
| STARSBackbone=LLAMA-3.2-3B-INSTRUCT, Temperature (T)=0.6, C=0.12026.01 | 6.45 | 5.46 | 6.01 | 4.78 | 5.57 | 5.65 | |
| STARSBackbone=LLAMA-3.2-3B-INSTRUCT, Temperature (T)=0.4, C=0.12026.01 | 6.44 | 5.46 | 6.02 | 4.23 | 5.43 | 5.52 | |
| SAMPLINGBackbone=LLAMA-3.2-3B-INSTRUCT, Temperature (T)=0.62026.01 | 6.43 | 5.42 | 5.99 | 4.59 | 5.46 | 5.58 | |
| SAMPLINGBackbone=LLAMA-3.2-3B-INSTRUCT, Temperature (T)=0.22026.01 | 6.42 | 5.45 | 6.03 | 3.27 | 5.19 | 5.27 | |
| SAMPLINGBackbone=LLAMA-3.2-3B-INSTRUCT, Temperature (T)=0.42026.01 | 6.41 | 5.42 | 6 | 4.17 | 5.35 | 5.47 | |
| STARSBackbone=QWEN2.5-3B-INSTRUCT, Temperature (T)=1, C=0.52026.01 | 6.3 | 5.45 | 5.75 | 5.81 | 5.7 | 5.8 | |
| STARSBackbone=QWEN2.5-3B-INSTRUCT, Temperature (T)=1, C=0.12026.01 | 6.26 | 5.64 | 5.79 | 5.32 | 5.71 | 5.74 | |
| SAMPLINGBackbone=QWEN2.5-3B-INSTRUCT, Temperature (T)=12026.01 | 6.22 | 5.5 | 5.78 | 5.42 | 5.61 | 5.71 | |
| SAMPLINGBackbone=QWEN2.5-3B-INSTRUCT, Temperature (T)=0.82026.01 | 6.2 | 5.55 | 5.76 | 5.02 | 5.5 | 5.6 | |
| STARSBackbone=QWEN2.5-3B-INSTRUCT, Temperature (T)=0.6, C=0.12026.01 | 6.17 | 5.59 | 5.73 | 5.19 | 5.55 | 5.64 | |
| STARSBackbone=QWEN2.5-3B-INSTRUCT, Temperature (T)=0.8, C=0.12026.01 | 6.14 | 5.57 | 5.8 | 5.45 | 5.67 | 5.73 | |
| STARSBackbone=QWEN2.5-3B-INSTRUCT, Temperature (T)=0.8, C=0.52026.01 | 6.13 | 5.62 | 5.7 | 5.96 | 5.74 | 5.83 | |
| SAMPLINGT=1, Backbone=Qwen2.5-3B-Instruct2026.01 | 6.13 | 5.55 | 5.81 | 4.83 | 5.46 | 5.56 | |
| STARSBackbone=QWEN2.5-3B-INSTRUCT, Temperature (T)=0.4, C=0.12026.01 | 6.09 | 5.7 | 5.76 | 4.61 | 5.47 | 5.53 | |
| SAMPLINGT=0.8, Backbone=Qwen2.5-3B-Instruct2026.01 | 6.09 | 5.56 | 5.8 | 4.55 | 5.39 | 5.48 | |
| SAMPLINGBackbone=QWEN2.5-3B-INSTRUCT, Temperature (T)=0.62026.01 | 6.07 | 5.63 | 5.68 | 4.51 | 5.38 | 5.45 | |
| STARSBackbone=QWEN2.5-3B-INSTRUCT, Temperature (T)=0.2, C=0.12026.01 | 6.06 | 5.61 | 5.79 | 4.2 | 5.3 | 5.39 | |
| SAMPLINGT=0.6, Backbone=Qwen2.5-3B-Instruct2026.01 | 6.06 | 5.57 | 5.8 | 4.19 | 5.3 | 5.38 | |
| SAMPLINGBackbone=QWEN2.5-3B-INSTRUCT, Temperature (T)=0.22026.01 | 6.04 | 5.69 | 5.74 | 2.68 | 4.92 | 5.01 | |
| STARSBackbone=QWEN2.5-3B-INSTRUCT, Temperature (T)=0.2, C=0.52026.01 | 6.04 | 5.62 | 5.68 | 5.09 | 5.52 | 5.59 | |
| SAMPLINGBackbone=QWEN2.5-3B-INSTRUCT, Temperature (T)=0.42026.01 | 6.03 | 5.56 | 5.75 | 3.57 | 5.14 | 5.21 | |
| SAMPLINGTemperature=1.0, Backbone=Qwen2.5-3B2026.01 | 6.01 | 5.9 | 6.15 | 5.27 | 5.73 | 5.81 | |
| STARSTemperature=1.0, Backbone=Qwen2.5-3B, Alpha=0.12026.01 | 6.01 | 5.85 | 6.17 | 5.47 | 5.79 | 5.86 | |
| STARSBackbone=QWEN2.5-3B-INSTRUCT, Temperature (T)=0.6, C=0.52026.01 | 6.01 | 5.68 | 5.72 | 5.17 | 5.48 | 5.61 | |
| STARSBackbone=QWEN2.5-3B-INSTRUCT, Temperature (T)=0.4, C=0.52026.01 | 5.99 | 5.7 | 5.73 | 5.02 | 5.5 | 5.59 | |
| STARSTemperature=0.8, Backbone=Qwen2.5-3B, Alpha=0.12026.01 | 5.98 | 5.91 | 6.21 | 5.27 | 5.73 | 5.82 | |
| SAMPLINGTemperature=0.8, Backbone=Qwen2.5-3B2026.01 | 5.96 | 5.95 | 6.14 | 5 | 5.67 | 5.74 | |
| STARSTemperature=0.6, Backbone=Qwen2.5-3B, Alpha=0.12026.01 | 5.93 | 5.89 | 6.21 | 4.85 | 5.59 | 5.69 | |
| MEAN_0.1T=1, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.9 | 5.92 | 6.2 | 4.93 | 5.67 | 5.73 | |
| SAMPLINGTemperature=0.6, Backbone=Qwen2.5-3B2026.01 | 5.88 | 5.9 | 6.15 | 4.49 | 5.52 | 5.59 | |
| STARS_0.1T=1, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.88 | 5.91 | 6.19 | 5.12 | 5.65 | 5.75 | |
| STARSTemperature=0.4, Backbone=Qwen2.5-3B, Alpha=0.12026.01 | 5.86 | 5.97 | 6.21 | 4.67 | 5.58 | 5.66 | |
| MEAN_0.1T=0.8, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.86 | 5.94 | 6.22 | 4.75 | 5.56 | 5.67 | |
| SAMPLINGTemperature=0.4, Backbone=Qwen2.5-3B2026.01 | 5.84 | 5.98 | 6.21 | 3.5 | 5.27 | 5.36 | |
| SAMPLINGTemperature=0.2, Backbone=Qwen2.5-3B2026.01 | 5.83 | 6.05 | 6.26 | 2.6 | 5.05 | 5.16 | |
| STARSTemperature=0.2, Backbone=Qwen2.5-3B, Alpha=0.12026.01 | 5.83 | 5.98 | 6.25 | 3.99 | 5.41 | 5.49 | |
| STARS_0.1T=0.8, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.83 | 5.96 | 6.24 | 4.84 | 5.59 | 5.69 | |
| MEAN_0.1T=0.4, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.83 | 5.92 | 6.24 | 3.68 | 5.3 | 5.39 | |
| MEAN_0.1T=0.2, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.83 | 5.94 | 6.25 | 2.71 | 5.05 | 5.16 | |
| RAND_0.1T=1, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.82 | 5.97 | 6.18 | 4.79 | 5.57 | 5.67 | |
| MEAN_0.1T=0.6, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.81 | 5.93 | 6.22 | 4.3 | 5.45 | 5.54 | |
| STARS_0.1T=0.6, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.79 | 5.96 | 6.23 | 4.57 | 5.52 | 5.61 | |
| RAND_0.1T=0.8, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.76 | 6.01 | 6.2 | 4.65 | 5.54 | 5.63 | |
| SAMPLINGT=0.4, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.76 | 5.97 | 6.2 | 3.59 | 5.27 | 5.36 | |
| STARSTemperature=1.0, Backbone=Qwen2.5-3B, Alpha=0.52026.01 | 5.75 | 5.88 | 6.05 | 5.75 | 5.73 | 5.83 | |
| STARS_0.1T=0.4, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.75 | 6.01 | 6.22 | 4.3 | 5.45 | 5.55 | |
| STARS_0.1T=0.2, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.75 | 5.97 | 6.22 | 3.89 | 5.35 | 5.44 | |
| SAMPLINGT=0.2, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.74 | 6.02 | 6.23 | 2.61 | 5.03 | 5.13 | |
| RAND_0.1T=0.6, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.72 | 5.99 | 6.21 | 4.83 | 5.58 | 5.67 | |
| RAND_0.1T=0.2, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.72 | 6.04 | 6.24 | 3.27 | 5.19 | 5.29 | |
| RAND_0.1T=0.4, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.71 | 6.03 | 6.23 | 3.75 | 5.31 | 5.41 | |
| STARSTemperature=0.8, Backbone=Qwen2.5-3B, Alpha=0.52026.01 | 5.7 | 5.86 | 6.06 | 5.69 | 5.69 | 5.8 | |
| STARS_0.5T=1, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.65 | 5.92 | 6.05 | 5.43 | 5.67 | 5.74 | |
| STARSTemperature=0.4, Backbone=Qwen2.5-3B, Alpha=0.52026.01 | 5.62 | 5.94 | 6.08 | 5.18 | 5.57 | 5.68 | |
| STARSTemperature=0.6, Backbone=Qwen2.5-3B, Alpha=0.52026.01 | 5.6 | 5.88 | 6.03 | 5.3 | 5.57 | 5.67 | |
| STARSTemperature=0.2, Backbone=Qwen2.5-3B, Alpha=0.52026.01 | 5.56 | 5.91 | 6.07 | 5.08 | 5.54 | 5.63 | |
| STARS_0.5T=0.8, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.56 | 5.94 | 6.06 | 5.27 | 5.57 | 5.68 | |
| STARS_0.5T=0.6, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.51 | 5.97 | 6.08 | 5.01 | 5.5 | 5.62 | |
| STARS_0.5T=0.4, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.48 | 6.01 | 6.1 | 4.96 | 5.55 | 5.62 | |
| STARS_0.5T=0.2, Backbone=Qwen2.5-3B-Instruct2026.01 | 5.44 | 5.99 | 6.08 | 4.77 | 5.44 | 5.54 |