List your company
ResearchFormerly WizWand

Next Token Prediction on OpenWebText (PPL, Accuracy)

18.68PPLConcepts
-1,400.64128,179.776917,760.19527,340.6131Mar 31, 2026
Updated 7mo ago

Evaluation results

MethodLinks
ConceptsModel=Llama 3.1 8B, lambda=0.752026.0318.6840.1
ConceptsModel=Llama 3.1 8B, lambda=1.02026.0318.6840.11
ConceptsModel=Llama 3.1 8B, lambda=0.52026.0319.1939.24
ConceptsModel=Llama 3.1 8B, lambda=0.252026.0320.2638.01
BaselineModel=Llama 3.1 8B, lambda=Base2026.0322.2636.4
BaselineModel=Llama 3.1 8B, lambda=0.02026.0322.4236.26
ConceptsModel=Llama 3.2 3B, lambda=1.02026.0322.837.63
ConceptsModel=Llama 3.2 3B, lambda=0.752026.0323.2237.23
ConceptsModel=Llama 3.2 3B, lambda=0.52026.0324.1236.26
ConceptsModel=Llama 3.2 3B, lambda=0.252026.0325.6235.14
BaselineModel=Llama 3.2 3B, lambda=0.02026.0328.3933.41
BaselineModel=Llama 3.2 3B, lambda=Base2026.0328.4333.47
ConceptsModel=Llama 3.2 1B, lambda=1.02026.0330.4734.41
ConceptsModel=Llama 3.2 1B, lambda=0.752026.0331.2833.79
ConceptsModel=Llama 3.2 1B, lambda=0.52026.0332.6532.78
ConceptsModel=Llama 3.2 1B, lambda=0.252026.0334.8431.64
BaselineModel=Llama 3.2 1B, lambda=Base2026.0338.5630.11
BaselineModel=Llama 3.2 1B, lambda=0.02026.0338.7130.05
NoiseModel=Llama 3.1 8B, lambda=0.252026.0339.4933.37
NoiseModel=Llama 3.2 3B, lambda=0.252026.0347.9230.22
NoiseModel=Llama 3.2 1B, lambda=0.252026.0362.7526.51
NoiseModel=Llama 3.1 8B, lambda=0.52026.0378.430.42
NoiseModel=Llama 3.2 3B, lambda=0.52026.0399.1326.32
NoiseModel=Llama 3.2 1B, lambda=0.52026.03130.0822.38
NoiseModel=Llama 3.1 8B, lambda=0.752026.03203.1523.68
NoiseModel=Llama 3.2 3B, lambda=0.752026.03264.2119.2
NoiseModel=Llama 3.2 1B, lambda=0.752026.03374.0515.22
NoiseModel=Llama 3.2 1B, lambda=1.02026.0328,643.160.23
NoiseModel=Llama 3.2 3B, lambda=1.02026.0328,898.470.23
NoiseModel=Llama 3.1 8B, lambda=1.02026.0335,501.710.22