Unconditional Likelihood Evaluation on FineWeb sample-10BT
593.46Likelihoodσ-random
Evaluation Results
| Method | Links | |
|---|---|---|
| σ-randomBackbone=GPT-2 base (124M), rmax=0.42026.06 | 593.46 | |
| σ-temporalBackbone=GPT-2 base (124M), rmax=0.42026.06 | 29 | |
| AC-GPTBackbone=GPT-2 base (124M), rmax=0.42026.06 | 28.79 | |
| GPTBackbone=GPT-2 base (124M), rmax=0.42026.06 | 27.58 |