Zero-shot NLP Evaluation on Aggregate
60.47Average AccuracyVERSATILEFFN
Evaluation Results
| Method | Links | |
|---|---|---|
| VERSATILEFFNBase Model Params=1.21B, Protocol=Zero-shot2025.12 | 60.47 | |
| 4-LOOPBase Model Params=1.21B, Protocol=Zero-shot2025.12 | 60.09 | |
| 6-LOOPBase Model Params=1.21B, Protocol=Zero-shot2025.12 | 60.05 | |
| MOEBase Model Params=1.21B, Protocol=Zero-shot2025.12 | 59.65 | |
| 2-LOOPBase Model Params=1.21B, Protocol=Zero-shot2025.12 | 59.48 | |
| VERSATILEFFNBase Model Params=720.81M, Protocol=Zero-shot2025.12 | 57.03 | |
| BASEBase Model Params=1.21B, Protocol=Zero-shot2025.12 | 56.74 | |
| 6-LOOPBase Model Params=720.81M, Protocol=Zero-shot2025.12 | 56.55 | |
| 4-LOOPBase Model Params=720.81M, Protocol=Zero-shot2025.12 | 56.33 | |
| MOEBase Model Params=720.81M, Protocol=Zero-shot2025.12 | 55.87 | |
| 2-LOOPBase Model Params=720.81M, Protocol=Zero-shot2025.12 | 55.83 | |
| BASEBase Model Params=720.81M, Protocol=Zero-shot2025.12 | 53.83 | |
| VERSATILEFFNBase Model Params=354.71M, Protocol=Zero-shot2025.12 | 52.33 | |
| 4-LOOPBase Model Params=354.71M, Protocol=Zero-shot2025.12 | 51.98 | |
| 6-LOOPBase Model Params=354.71M, Protocol=Zero-shot2025.12 | 51.94 | |
| MOEBase Model Params=354.71M, Protocol=Zero-shot2025.12 | 51.48 | |
| 2-LOOPBase Model Params=354.71M, Protocol=Zero-shot2025.12 | 51.47 | |
| BASEBase Model Params=354.71M, Protocol=Zero-shot2025.12 | 47.98 |