Natural Language Inference on CB (F1)
61.51F1FLIPPED
Evaluation results
| Method | Links | |
|---|---|---|
| FLIPPEDModel Size=11B, Evaluation Protocol=Zero-shot2022.10 | 61.51 | |
| T0Model Size=11B, Evaluation Protocol=Zero-shot2022.10 | 53.82 | |
| FLIPPEDModel Size=3B, Evaluation Protocol=Zero-shot2022.10 | 52.27 | |
| DirectModel Size=3B, Evaluation Protocol=Zero-shot2022.10 | 49.81 | |
| T0Model Size=3B, Evaluation Protocol=Zero-shot2022.10 | 30.94 | |
| GPT-3Model Size=175B, Evaluation Protocol=Zero-shot2022.10 | 29.72 | |
| ChannelModel Size=3B, Evaluation Protocol=Zero-shot2022.10 | 22.35 |