Distribution-distance evaluation on Prompts 100 (evaluation)
94.1Distinct-N (WM)Adaptive
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| AdaptiveModel=Gemma-2 9B, Temperature (T)=1.0, Top-p (p)=0.952026.05 | 94.1 | 0.033 | 5.8 | -0.016 | 18.6 | |
| AdaptiveModel=Gemma-2 2B, Temperature (T)=1.0, Top-p (p)=0.952026.05 | 93.6 | 0.036 | 7.1 | -0.002 | 13 | |
| SLAM (k=10)Model=Gemma-2 2B, Temperature (T)=1.0, Top-p (p)=0.952026.05 | 88.8 | -0.013 | 5.8 | -0.015 | 19.4 | |
| SLAM (k=10)Model=Gemma-2 9B, Temperature (T)=1.0, Top-p (p)=0.952026.05 | 88.4 | -0.024 | 5.7 | -0.017 | 53.4 | |
| SynthIDModel=Gemma-2 9B, Temperature (T)=1.0, Top-p (p)=0.952026.05 | 74 | -0.167 | 9.7 | 0.024 | 19.9 | |
| SAEMarkModel=Gemma-2 9B, Temperature (T)=1.0, Top-p (p)=0.952026.05 | 68 | -0.228 | 12.5 | 0.051 | 0.7 | |
| SynthIDModel=Gemma-2 2B, Temperature (T)=1.0, Top-p (p)=0.952026.05 | 65.7 | -0.244 | 10.9 | 0.036 | 8.5 | |
| SAEMarkModel=Gemma-2 2B, Temperature (T)=1.0, Top-p (p)=0.952026.05 | 64.4 | -0.257 | 11.1 | 0.038 | 89.7 | |
| KGWModel=Gemma-2 9B, Temperature (T)=1.0, Top-p (p)=0.952026.05 | 42 | -0.488 | 12.5 | 0.051 | 6.5 | |
| EWDModel=Gemma-2 9B, Temperature (T)=1.0, Top-p (p)=0.952026.05 | 36.5 | -0.543 | 8.4 | 0.01 | 2.1 | |
| KGWModel=Gemma-2 2B, Temperature (T)=1.0, Top-p (p)=0.952026.05 | 35.6 | -0.545 | 13.2 | 0.059 | 1.2 | |
| EWDModel=Gemma-2 2B, Temperature (T)=1.0, Top-p (p)=0.952026.05 | 32.2 | -0.579 | 10.7 | 0.035 | 1.7 | |
| UnigramModel=Gemma-2 9B, Temperature (T)=1.0, Top-p (p)=0.952026.05 | 24.6 | -0.662 | 8.6 | 0.012 | 3 | |
| UnigramModel=Gemma-2 2B, Temperature (T)=1.0, Top-p (p)=0.952026.05 | 20.9 | -0.692 | 11.1 | 0.038 | 1.9 |