Downstream Performance Evaluation on BoolQ, MMLU, WinoG
71.9BoolQ AccuracyCBD
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CBDTokens=100M, Param=537M2026.05 | 71.9 | 26.3 | 60.2 | 44.06 | |
| CBDTokens=500M, Param=277M2026.05 | 67.8 | 27.1 | 63.74 | 43.87 | |
| CBDTokens=500M, Param=537M2026.05 | 67.8 | 25.3 | 62.3 | 43.69 | |
| HyperCloningTokens=500M, Param=645M2026.05 | 63.9 | 23.99 | 46.47 | 38 | |
| HyperCloningTokens=500M, Param=2423M2026.05 | 63.55 | 24.21 | 45.88 | 38.28 |