Language Modeling on GitHub tokens (test)
0.976Bits Per Token (BPT)Rec:fixed:skip
Evaluation results
| Method | Links | |
|---|---|---|
| Rec:fixed:skipsegment length=4096, window length=512, step time (relative)=0.992022.03 | 0.976 | |
| Rec:fixed:dualsegment length=4096, window length=512, step time (relative)=1.012022.03 | 0.991 | |
| Rec:fixed:singlesegment length=4096, window length=512, step time (relative)=1.022022.03 | 1 | |
| XL:2048segment length=2048, window length=2048, step time (relative)=2.112022.03 | 1.01 | |
| Rec:lstm:dualsegment length=4096, window length=512, step time (relative)=1.062022.03 | 1.01 | |
| Rec:lstm:singlesegment length=4096, window length=512, step time (relative)=1.052022.03 | 1.03 | |
| XL:1024segment length=1024, window length=1024, step time (relative)=1.22022.03 | 1.08 | |
| Rec:lstm:skipsegment length=4096, window length=512, step time (relative)=12022.03 | 1.1 | |
| Slide:13Lsegment length=4096, window length=512, step time (relative)=12022.03 | 1.17 | |
| Slide:12Lsegment length=4096, window length=512, step time (relative)=0.932022.03 | 1.19 | |
| XL:512segment length=512, window length=512, step time (relative)=0.882022.03 | 1.21 |