Zero-shot Learning on 11 evaluation datasets
64.5AccuracyMHR-μ
Evaluation Results
| Method | Links | |
|---|---|---|
| MHR-μBackbone=T0-11B, k=10002022.11 | 64.5 | |
| MHR-μBackbone=T0-11B, k=50002022.11 | 64.5 | |
| Poly-μBackbone=T0-11B, k=100002022.11 | 64.4 | |
| MHR-μBackbone=T0-11B, k=100002022.11 | 64.4 | |
| Poly-μBackbone=T0-11B, k=50002022.11 | 63.9 | |
| Poly-μBackbone=T0-11B, k=10002022.11 | 63.6 | |
| MHR-μBackbone=T0-11B, k=02022.11 | 63.5 | |
| Poly-μBackbone=T0-11B, k=02022.11 | 62.1 | |
| LoRABackbone=T0-11B, k=10002022.11 | 61.6 | |
| LoRABackbone=T0-11B, k=50002022.11 | 61.5 | |
| LoRABackbone=T0-11B, k=100002022.11 | 61.5 | |
| LoRABackbone=T0-11B, k=02022.11 | 61.2 | |
| BackboneBackbone=T0-11B, k=02022.11 | 61 | |
| MHR-μBackbone=T5-XL-LM, k=10002022.11 | 58 | |
| MHR-μBackbone=T5-XL-LM, k=50002022.11 | 57.1 | |
| Poly-μBackbone=T5-XL-LM, k=50002022.11 | 56.8 | |
| LoRABackbone=T5-XL-LM, k=02022.11 | 56.5 | |
| Poly-μBackbone=T5-XL-LM, k=100002022.11 | 56.3 | |
| MHR-μBackbone=T5-XL-LM, k=100002022.11 | 56.3 | |
| LoRABackbone=T5-XL-LM, k=50002022.11 | 56.1 | |
| LoRABackbone=T5-XL-LM, k=10002022.11 | 56 | |
| LoRABackbone=T5-XL-LM, k=100002022.11 | 55.7 | |
| Poly-μBackbone=T5-XL-LM, k=10002022.11 | 53 | |
| MHR-μBackbone=T5-XL-LM, k=02022.11 | 48 | |
| Poly-μBackbone=T5-XL-LM, k=02022.11 | 46 | |
| BackboneBackbone=T5-XL-LM, k=02022.11 | 43.2 |