Predicting object attributes on PIGPEN-NLU seen (test)
83.8AccuracyPIGLET
Evaluation results
| Method | Links | |
|---|---|---|
| PIGLET2021.06 | 83.8 | |
| T5-11BApproach category=text-to-text2021.06 | 79.5 | |
| T5-3BApproach category=text-to-text2021.06 | 77.1 | |
| Alberti et al.2019Approach category=BERT-style, Dynamics pre-training=true2021.06 | 71.4 | |
| T5-LargeApproach category=text-to-text2021.06 | 69.2 | |
| T5-BaseApproach category=text-to-text2021.06 | 69.2 | |
| G&D2019Approach category=BERT-style, Dynamics pre-training=true2021.06 | 60.9 | |
| T5-SmallApproach category=text-to-text2021.06 | 57 | |
| No Change2021.06 | 29.9 | |
| G&D2019Approach category=BERT-style, Dynamics pre-training=false2021.06 | 23.1 | |
| GPT3-175Bfew-shot=true2021.06 | 22.4 | |
| Alberti et al.2019Approach category=BERT-style, Dynamics pre-training=false2021.06 | 16.2 |