Long-form Generation on Alpaca
2.4268Perplexity (PPL)I-GLASS
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| I-GLASSModel=Gemma 2 27B2025.08 | 2.4268 | 0.3349 | |
| A-GLASSModel=Gemma 2 27B2025.08 | 2.486 | 0.3515 | |
| GRIFFINModel=Gemma 2 27B2025.08 | 2.7729 | 0.4338 | |
| I-GLASSModel=Gemma 7B2025.08 | 3.3982 | 0.5661 | |
| I-GLASSModel=Gemma 2 9B2025.08 | 3.4962 | 0.5821 | |
| A-GLASSModel=Gemma 2 9B2025.08 | 3.5105 | 0.5877 | |
| A-GLASSModel=Gemma 7B2025.08 | 3.5635 | 0.5998 | |
| GRIFFINModel=Gemma 7B2025.08 | 3.7014 | 0.6453 | |
| I-GLASSModel=Phi 3 14B (medium)2025.08 | 3.7364 | 0.6188 | |
| GRIFFINModel=Phi 3 14B (medium)2025.08 | 3.8981 | 0.6763 | |
| GRIFFINModel=Gemma 2 9B2025.08 | 4.0143 | 0.697 | |
| I-GLASSModel=Llama 3 8B2025.08 | 4.0295 | 0.7354 | |
| A-GLASSModel=Llama 3 8B2025.08 | 4.0374 | 0.7407 | |
| A-GLASSModel=Phi 3 14B (medium)2025.08 | 4.1384 | 0.6928 | |
| A-GLASSModel=Mistral 7B2025.08 | 4.4786 | 0.7615 | |
| I-GLASSModel=Mistral 7B2025.08 | 4.486 | 0.7593 | |
| GRIFFINModel=Mistral 7B2025.08 | 5.0059 | 0.8774 | |
| I-GLASSModel=Qwen 2.5 14B2025.08 | 5.0279 | 0.568 | |
| GRIFFINModel=Qwen 2.5 7B2025.08 | 5.084 | 0.6772 | |
| GRIFFINModel=Llama 3 8B2025.08 | 5.2523 | 0.9426 | |
| GRIFFINModel=Qwen 2.5 14B2025.08 | 5.433 | 0.6557 | |
| I-GLASSModel=Qwen 2.5 7B2025.08 | 5.5424 | 0.6684 | |
| A-GLASSModel=Qwen 2.5 7B2025.08 | 5.5823 | 0.688 | |
| A-GLASSModel=Qwen 2.5 14B2025.08 | 5.5823 | 0.5947 | |
| A-GLASSModel=Gemma 3n E4B2025.08 | 5.9075 | 0.9796 | |
| I-GLASSModel=Gemma 3n E4B2025.08 | 6.3256 | 1.019 | |
| GRIFFINModel=Gemma 3n E4B2025.08 | 8.5984 | 1.3106 | |
| A-GLASSModel=Gemma 3n E2B2025.08 | 12.7155 | 1.4841 | |
| I-GLASSModel=Gemma 3n E2B2025.08 | 14.424 | 1.5677 | |
| GRIFFINModel=Gemma 3n E2B2025.08 | 23.1611 | 1.9983 |