Relational Reasoning on RAVEN (test)
92.5Average AccuracyIV-CL
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| IV-CLBackbone=ViT-B2023.07 | 92.5 | 98.4 | 82.6 | 78.4 | 96.6 | 97.2 | 99 | 95.4 | |
| SCLBackbone=ViT-B2023.07 | 91.6 | 98.1 | 91 | 82.5 | 96.8 | 96.5 | 96 | 80.1 | |
| CoPINetBackbone=ViT-B2023.07 | 91.4 | 95.1 | 77.5 | 78.9 | 99.1 | 99.7 | 98.5 | 91.4 | |
| ResNet + DRTBackbone=ViT-B2023.07 | 59.6 | 58.1 | 46.5 | 50.4 | 65.8 | 67.1 | 69.1 | 60.1 | |
| LSTMBackbone=ViT-B2023.07 | 13.1 | 13.2 | 14.1 | 13.7 | 12.8 | 12.4 | 12.2 | 13 |