List your company
ResearchFormerly WizWand

Next Token Prediction on C4

21.1OOD PerplexityConcepts
-1,144.78486,724.937614,594.6622,464.3824Mar 31, 2026
Updated 7mo ago

Evaluation results

MethodLinks
ConceptsModel=Llama 3.1 8B, λ=1.02026.0321.139.38
ConceptsModel=Llama 3.1 8B, λ=0.752026.0321.5139.12
ConceptsModel=Llama 3.1 8B, λ=0.52026.0322.2138.29
ConceptsModel=Llama 3.1 8B, λ=0.252026.0323.4537.1
ConceptsModel=Llama 3.2 3B, λ=1.02026.0325.0837.34
BaselineModel=Llama 3.1 8B, λ=Base2026.0325.136.01
BaselineModel=Llama 3.1 8B, λ=0.02026.0325.835.52
ConceptsModel=Llama 3.2 3B, λ=0.752026.0325.8436.9
ConceptsModel=Llama 3.2 3B, λ=0.52026.0326.936.17
ConceptsModel=Llama 3.2 3B, λ=0.252026.0328.5735.13
BaselineModel=Llama 3.2 3B, λ=Base2026.033133.91
BaselineModel=Llama 3.2 3B, λ=0.02026.0331.5333.62
ConceptsModel=Llama 3.2 1B, λ=1.02026.0332.9134.08
ConceptsModel=Llama 3.2 1B, λ=0.752026.0333.6733.58
ConceptsModel=Llama 3.2 1B, λ=0.52026.0335.1332.75
ConceptsModel=Llama 3.2 1B, λ=0.252026.0337.4631.83
BaselineModel=Llama 3.2 1B, λ=Base2026.0340.6130.61
NoiseModel=Llama 3.1 8B, λ=0.252026.0341.433.02
BaselineModel=Llama 3.2 1B, λ=0.02026.0341.5430.24
NoiseModel=Llama 3.2 3B, λ=0.252026.0349.730.46
NoiseModel=Llama 3.2 1B, λ=0.252026.0366.226.73
NoiseModel=Llama 3.1 8B, λ=0.52026.0379.7429.67
NoiseModel=Llama 3.2 3B, λ=0.52026.03100.225.95
NoiseModel=Llama 3.2 1B, λ=0.52026.03137.0421.88
NoiseModel=Llama 3.1 8B, λ=0.752026.03217.3322.93
NoiseModel=Llama 3.2 3B, λ=0.752026.03273.0719.02
NoiseModel=Llama 3.2 1B, λ=0.752026.03399.6614.52
NoiseModel=Llama 3.2 3B, λ=1.02026.0322,826.870.55
NoiseModel=Llama 3.2 1B, λ=1.02026.0323,964.930.39
NoiseModel=Llama 3.1 8B, λ=1.02026.0329,168.220.37