Knowledge Probing on Chemical Reactions
43.1AccuracyGAL 120B
Evaluation results
| Method | Links | |
|---|---|---|
| GAL 120BParams (bn)=120, zero-shot=true2022.11 | 43.1 | |
| GAL 30BParams (bn)=30, zero-shot=true2022.11 | 36.5 | |
| GPT-3 (text-davinci-002)Params (bn)=?, zero-shot=true2022.11 | 35.1 | |
| GAL 6.7BParams (bn)=6.7, zero-shot=true2022.11 | 26.4 | |
| BLOOMParams (bn)=176, zero-shot=true2022.11 | 22.4 | |
| GAL 1.3BParams (bn)=1.3, zero-shot=true2022.11 | 14.4 | |
| OPTParams (bn)=175, zero-shot=true2022.11 | 12.7 | |
| GAL 125MParams (bn)=0.1, zero-shot=true2022.11 | 0.3 |