Language Modeling on GPT-OSS 20B held-out (test)
34.56PerplexityDonor
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DonorModel=GPT-OSS (20B), Trainable %=14.6%2026.01 | 34.56 | 2.7 | — | |
| LoRAModel=GPT-OSS (20B), Trainable %=0.01%2026.01 | 98.37 | 76.2 | 28.2 | |
| IA3Model=GPT-OSS (20B), Trainable %=0.0001%2026.01 | 214.99 | 76.5 | 28.3 | |
| Top-KModel=GPT-OSS (20B), Trainable %=10.6%2026.01 | 365.83 | 22.2 | 8.2 | |
| Zero-shotModel=GPT-OSS (20B), Trainable %=0%2026.01 | 397.78 | — | — |