Wiki
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Wiki
100M Value
5
Wiki 1.0 (test)
25Boundary Similarity (n=2)
5
Wiki (test)
96.7Alignment F1 (S)
5
WIKI
0.42MAE
5
wiki (test)
0.047CRPS Sum
5
Wiki-30K
85.26P@1
5
Wiki NIPS 2000
4.76NRMSE
4
WIKI
2.16Memory (GB)
4
Wiki Wikipedia prompts (val)
96.6Accuracy
4
Wiki Wikipedia prompts (train)
95.8Accuracy
4
Wiki
10,431Output Size
4
Wiki 10% (train val)
41.9Accuracy
4
Wiki (test)
82F1 Score
4
Wiki-500K (train)
37.6Training Time (hours)
4
Wiki 500K
27.3Inference Time (ms/sample)
4
Wiki-500K large scale XMC (test)
0.358PSP@1
4
Wiki-500K
37.6Training Time (hours)
4
wiki (test)
31,000,000MSE
4
wiki 2 (test)
0.681HV_uni
3
Wiki2000 GluonTS
0.369CRPS
2
Wiki
9.98Build Time (s)
2
Wiki (test)
20.54Perplexity
2
Wiki
8.98NLL
2
Wiki Wikipedia
89BLEU
2
Mini-wiki 3029 derivative (test)
—Primary metric
0