Social Reasoning on SIQA
15.2Performance (%)Autoregressive
Evaluation results
| Method | Links | |
|---|---|---|
| AutoregressiveAlpha (α)=1, Data repetitions=12025.12 | 15.2 | |
| DualAlpha (α)=3/4, Data repetitions=322025.12 | 14.6 | |
| DualAlpha (α)=63/64, Data repetitions=12025.12 | 14.3 | |
| AutoregressiveAlpha (α)=1, Data repetitions=322025.12 | 14.2 | |
| DualAlpha (α)=1/8, Data repetitions=1282025.12 | 13.3 | |
| AutoregressiveAlpha (α)=1, Data repetitions=1282025.12 | 8.9 |