List your company
ResearchFormerly WizWand

Relational Reasoning on Sort-of-CLEVR (test)

80.03Relational AccuracyAiT-Base
45.60654.54363.4872.417Sep 22, 2023
Updated 8mo ago

Evaluation results

MethodLinks
AiT-BaseModel architecture=Transformer based, Model scale=Base2023.0980.0399.98
AiT-MediumModel architecture=Transformer based, Model scale=Medium2023.0978.1499.75
AiT-SmallModel architecture=Transformer based, Model scale=Small2023.0976.8299.85
CoordinationModel architecture=Transformer based2023.0973.4396.31
ViT-BaseModel architecture=Vision Transformer, Model scale=Base2023.0963.3599.73
CNN+LSTMModel architecture=Non-Transformer based2023.0960.0899.47
ViT-MediumModel architecture=Vision Transformer, Model scale=Medium2023.0954.7199.7
ViT-SmallModel architecture=Vision Transformer, Model scale=Small2023.0951.7598.8
Set TransformerModel architecture=Transformer based2023.0947.6357.65
Dense-SmallModel architecture=Non-Transformer based (Fully-connected), Model scale=Small2023.0947.2857.68
Dense-BaseModel architecture=Non-Transformer based (Fully-connected), Model scale=Base2023.0946.9357.71