Personalized Persuasive Generation on Vaccination new-family
1.1PBI Score (Generation)SR-M3-GM
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| SR-M3-GMStudent Model=Gemma-2-9B-it, Recipe=SR-M32026.06 | 1.1 | 0.9873 | 12.3 | 62.03 | 1 | 15 | 57.06 | 40.12 | 97.78 | 1.66 | |
| T32-Pref-NLIStable-GMStudent Model=Gemma-2-9B-it, Teacher Model=Qwen2.5-32B-Instruct, Recipe=T32-Pref-NLIStable2026.06 | 0.9533 | 0.8451 | 12.78 | 62.32 | 2 | 14 | 63.27 | 44.95 | 97.31 | 0.86 | |
| T32-M2-GMStudent Model=Gemma-2-9B-it, Teacher Model=Qwen2.5-32B-Instruct, Recipe=T32-M22026.06 | 0.945 | 0.9948 | 9.93 | 86.32 | 6 | 13 | 76.81 | 41.14 | 97.8 | 1.5 | |
| T32-M3-Soft-GMStudent Model=Gemma-2-9B-it, Teacher Model=Qwen2.5-32B-Instruct, Recipe=T32-M3-Soft2026.06 | 0.9363 | 1.0326 | 11.07 | 107.9 | 3 | 15 | 47.33 | 48.81 | 97.65 | 0.13 | |
| T32-Pref-Std-GMStudent Model=Gemma-2-9B-it, Teacher Model=Qwen2.5-32B-Instruct, Recipe=T32-Pref-Std2026.06 | 0.9253 | 0.9891 | 14.03 | 73 | 2 | 7 | 23.89 | 48.17 | 98.22 | 0.42 | |
| SR-M2-GMStudent Model=Gemma-2-9B-it, Recipe=SR-M22026.06 | 0.9097 | 0.9699 | 3.73 | 37.4 | 1 | 9 | 54.85 | 59.27 | 96.67 | 1.1 | |
| Orig-GMStudent Model=Gemma-2-9B-it2026.06 | 0.8833 | 0.95 | 9.06 | 75.99 | 2 | 9 | 76.41 | 38.44 | 97.92 | 0.32 | |
| T32-M3-GMStudent Model=Gemma-2-9B-it, Teacher Model=Qwen2.5-32B-Instruct, Recipe=T32-M32026.06 | 0.84 | 0.9618 | 11.85 | 100.83 | 4 | 16 | 36.82 | 52.12 | 98.05 | 0.76 |