Predictive Organization Analysis on 1000 random contexts
24PEAK z-scoreOLMo-1B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| OLMo-1Bd=2048, L=16, k=100, random subspaces=100, contexts=10002026.05 | 24 | 15 | 13 | 17 | — | |
| Pythia-6.9Bd=4096, L=32, k=100, random subspaces=100, contexts=10002026.05 | 17.93 | 9 | 28 | 32 | — | |
| Gemma-2-2Bd=2304, L=26, k=100, random subspaces=100, contexts=10002026.05 | 16.36 | 22 | 26 | 26 | 16.5 | |
| Pythia-70Md=512, L=6, k=100, random subspaces=100, contexts=10002026.05 | 16.26 | 6 | 1 | 2 | 11 | |
| Pythia-160Md=768, L=12, k=100, random subspaces=100, contexts=10002026.05 | 15.07 | 12 | 1 | 4 | 13 | |
| Pythia-2.8Bd=2560, L=32, k=100, random subspaces=100, contexts=10002026.05 | 14.53 | 15 | 23 | 32 | — | |
| Pythia-1Bd=2048, L=16, k=100, random subspaces=100, contexts=10002026.05 | 12.85 | 8 | 14 | 16 | — | |
| Phi-1.5d=2048, L=24, k=100, random subspaces=100, contexts=10002026.05 | 12.39 | 24 | 15 | 24 | — | |
| Pythia-1.4Bd=2048, L=24, k=100, random subspaces=100, contexts=10002026.05 | 12.34 | 12 | 12 | 17 | 0.5 | |
| Pythia-410Md=1024, L=24, k=100, random subspaces=100, contexts=10002026.05 | 9.27 | 24 | 9 | 16 | 32 |