Abstract Visual Reasoning on RAVEN v1 (test)
93.6Average AccuracyDCNet
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| DCNet2023.03 | 93.6 | 97.8 | 81.7 | 86.7 | 99 | 91.5 | 99.8 | 99.8 | |
| algebraic machine reasoning2023.03 | 92.9 | 98.8 | 91.9 | 93.1 | 98.2 | 70.1 | 99.2 | 99.1 | |
| COPINet2023.03 | 91.4 | 95.1 | 77.5 | 78.9 | 98.5 | 91.4 | 99.1 | 99.7 | |
| Human2021.03 | 84.41 | 95.45 | 81.82 | 79.55 | 86.36 | 81.81 | 86.36 | 81.81 | |
| Human2023.03 | 84.4 | 95.5 | 81.8 | 79.6 | 86.4 | 81.8 | 86.4 | 81.8 | |
| LEN2023.03 | 72.9 | 80.2 | 57.5 | 62.1 | 84.4 | 71.5 | 73.5 | 81.2 | |
| PrAE Learnertraining_data=2x2Grid only2021.03 | 65.03 | 76.5 | 78.6 | 28.55 | 48.05 | 42.6 | 90.05 | 90.85 | |
| PrAE2023.03 | 65 | 76.5 | 78.6 | 28.6 | 48.1 | 42.6 | 90.1 | 90.9 | |
| ResNet+DRT2023.03 | 59.6 | 58.1 | 46.5 | 50.4 | 69.1 | 60.1 | 65.8 | 67.1 | |
| ResNet2023.03 | 53.4 | 52.8 | 41.9 | 44.3 | 63.2 | 53.1 | 58.8 | 60.2 | |
| CoPINettraining_data=2x2Grid only2021.03 | 52.96 | 49.45 | 61.55 | 52.15 | 39.55 | 34.55 | 68.1 | 65.4 | |
| NCD2023.03 | 37 | 45.5 | 35.5 | 39.5 | 40.3 | 30 | 34.9 | 33.4 | |
| WReN2023.03 | 34 | 58.4 | 38.9 | 37.7 | 38.8 | 22.6 | 21.6 | 19.7 | |
| ResNet+DRTtraining_data=2x2Grid only2021.03 | 31.56 | 31.65 | 39.55 | 35.55 | 31.4 | 25.05 | 25.65 | 32.05 | |
| ResNettraining_data=2x2Grid only2021.03 | 24.79 | 24.3 | 25.05 | 25.8 | 25.05 | 22.15 | 23.8 | 27.4 | |
| MXGNettraining_data=2x2Grid only2021.03 | 20.78 | 12.95 | 37.05 | 24.8 | 18.05 | 18.35 | 17.45 | 16.8 | |
| SRANtraining_data=2x2Grid only2021.03 | 15.56 | 18.35 | 38.8 | 17.4 | 5.5 | 8.05 | 9.45 | 11.35 | |
| CNNtraining_data=2x2Grid only2021.03 | 14.78 | 13.8 | 18.25 | 14.55 | 14.35 | 13.75 | 13.35 | 15.4 | |
| LSTM2023.03 | 13.1 | 13.2 | 14.1 | 13.7 | 12.2 | 13 | 12.8 | 12.4 | |
| LSTMtraining_data=2x2Grid only2021.03 | 12.81 | 12.7 | 13.8 | 12.9 | 12.45 | 13.3 | 12.4 | 12.1 | |
| LENtraining_data=2x2Grid only2021.03 | 12.29 | 11.85 | 41.4 | 12.95 | 5.55 | 6.35 | 3.95 | 3.95 | |
| WRENtraining_data=2x2Grid only2021.03 | 9.86 | 8.65 | 29.6 | 9.75 | 5.7 | 5.9 | 4.4 | 5 |