Language Modeling on The Pile FreeLaw (test)
71.63BPB (%)HullFT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HullFTTime Budget (T)=2.0s, Average Selection Size (N*)=222026.05 | 71.63 | — | 1.1 | |
| kNNTime Budget (T)=2.0s, Average Selection Size (N*)=172026.05 | 72.73 | — | — | |
| HullFTTime Budget (T)=1.75s, Average Selection Size (N*)=192026.05 | 72.98 | — | 1.01 | |
| kNNTime Budget (T)=1.75s, Average Selection Size (N*)=152026.05 | 73.99 | — | — | |
| SIFTTime Budget (T)=2.0s, Average Selection Size (N*)=132026.05 | 74.4 | — | — | |
| SIFTTime Budget (T)=1.75s, Average Selection Size (N*)=112026.05 | 76.32 | — | — | |
| Split ModelModel structure=Split, Total compute budget=720B tokens, Number of parameters=1.3B, ts=340B2026.03 | — | 4.85 | — | |
| Standalone Pretrained ModelModel structure=Standalone, Total compute budget=720B tokens, Number of parameters=1.3B2026.03 | — | 5.76 | — |