List your company
ResearchFormerly WizWand

Next Token Prediction on C4 (held-out)

21.5Perplexity (PPL)Concepts
-931.62365,501.960711,935.54518,369.1293Mar 31, 2026
Updated 7mo ago

Evaluation results

MethodLinks
ConceptsModel=Llama 3.1 8B, lambda=0.752026.0321.539.11
ConceptsModel=Llama 3.1 8B, lambda=0.52026.0321.8838.39
ConceptsModel=Llama 3.1 8B, lambda=1.02026.0322.0339.02
ConceptsModel=Llama 3.1 8B, lambda=0.252026.0322.9537.5
BaselineModel=Llama 3.1 8B, lambda=Base2026.0325.136.01
BaselineModel=Llama 3.1 8B, lambda=0.02026.0325.2735.86
ConceptsModel=Llama 3.2 3B, lambda=0.752026.0325.737.08
ConceptsModel=Llama 3.2 3B, lambda=1.02026.0325.7837.17
ConceptsModel=Llama 3.2 3B, lambda=0.52026.0326.4636.48
ConceptsModel=Llama 3.2 3B, lambda=0.252026.0327.9335.39
BaselineModel=Llama 3.2 3B, lambda=Base2026.0330.133.91
BaselineModel=Llama 3.2 3B, lambda=0.02026.0330.9133.72
ConceptsModel=Llama 3.2 1B, lambda=1.02026.0333.1134.19
ConceptsModel=Llama 3.2 1B, lambda=0.752026.0333.233.88
ConceptsModel=Llama 3.2 1B, lambda=0.52026.0334.3833.22
ConceptsModel=Llama 3.2 1B, lambda=0.252026.0336.4832.24
BaselineModel=Llama 3.2 1B, lambda=0.02026.0340.4930.57
BaselineModel=Llama 3.2 1B, lambda=Base2026.0340.6130.61
NoiseModel=Llama 3.1 8B, lambda=0.252026.0343.6532.86
NoiseModel=Llama 3.2 3B, lambda=0.252026.0352.7130.22
NoiseModel=Llama 3.2 1B, lambda=0.252026.0367.8226.39
NoiseModel=Llama 3.1 8B, lambda=0.52026.0385.5829.5
NoiseModel=Llama 3.2 3B, lambda=0.52026.03108.525.89
NoiseModel=Llama 3.2 1B, lambda=0.52026.03139.5521.59
NoiseModel=Llama 3.1 8B, lambda=0.752026.03223.0122.17
NoiseModel=Llama 3.2 3B, lambda=0.752026.03299.1117.71
NoiseModel=Llama 3.2 1B, lambda=0.752026.03401.5214.05
NoiseModel=Llama 3.2 3B, lambda=1.02026.0319,518.80.28
NoiseModel=Llama 3.2 1B, lambda=1.02026.0319,670.630.25
NoiseModel=Llama 3.1 8B, lambda=1.02026.0323,849.590.24