Reading Comprehension on RACE-m (val)
86.8AccuracyFT
Evaluation results
| Method | Links | |
|---|---|---|
| FTtuning_strategy=fine-tuning2021.09 | 86.8 | |
| Unified PPTtuning_strategy=unified pre-trained prompt tuning2021.09 | 86.4 | |
| PPTtuning_strategy=pre-trained prompt tuning2021.09 | 85.9 | |
| PTtuning_strategy=prompt-tuning2021.09 | 85 | |
| DeepSeekMoE# Shot=5-shot, # Total Params=2.0B, # Activated Params=0.3B, FLOPs per 2K Tokens=4.3T, # Training Tokens=100B2024.01 | 44 | |
| Switch# Shot=5-shot, # Total Params=2.0B, # Activated Params=0.2B, FLOPs per 2K Tokens=2.9T, # Training Tokens=100B2024.01 | 43.6 | |
| GShard# Shot=5-shot, # Total Params=2.0B, # Activated Params=0.3B, FLOPs per 2K Tokens=4.3T, # Training Tokens=100B2024.01 | 42.1 | |
| Dense# Shot=5-shot, # Total Params=0.2B, # Activated Params=0.2B, FLOPs per 2K Tokens=2.9T, # Training Tokens=100B2024.01 | 38.8 | |
| Hash Layer# Shot=5-shot, # Total Params=2.0B, # Activated Params=0.2B, FLOPs per 2K Tokens=2.9T, # Training Tokens=100B2024.01 | 38.8 |