Abstract Visual Reasoning on RAVEN v1 (test) benchmark leaderboard · SOTA2 Research

Abstract Visual Reasoning on RAVEN v1 (test)

93.6Average AccuracyDCNet

Evaluation Results

Method
DCNet2023.03	93.6	97.8	81.7	86.7	99	91.5	99.8	99.8
algebraic machine reasoning2023.03	92.9	98.8	91.9	93.1	98.2	70.1	99.2	99.1
COPINet2023.03	91.4	95.1	77.5	78.9	98.5	91.4	99.1	99.7
Human2021.03	84.41	95.45	81.82	79.55	86.36	81.81	86.36	81.81
Human2023.03	84.4	95.5	81.8	79.6	86.4	81.8	86.4	81.8
LEN2023.03	72.9	80.2	57.5	62.1	84.4	71.5	73.5	81.2
PrAE Learner2021.03	65.03	76.5	78.6	28.55	48.05	42.6	90.05	90.85
PrAE2023.03	65	76.5	78.6	28.6	48.1	42.6	90.1	90.9
ResNet+DRT2023.03	59.6	58.1	46.5	50.4	69.1	60.1	65.8	67.1
ResNet2023.03	53.4	52.8	41.9	44.3	63.2	53.1	58.8	60.2
CoPINet2021.03	52.96	49.45	61.55	52.15	39.55	34.55	68.1	65.4
NCD2023.03	37	45.5	35.5	39.5	40.3	30	34.9	33.4
WReN2023.03	34	58.4	38.9	37.7	38.8	22.6	21.6	19.7
ResNet+DRT2021.03	31.56	31.65	39.55	35.55	31.4	25.05	25.65	32.05
ResNet2021.03	24.79	24.3	25.05	25.8	25.05	22.15	23.8	27.4
MXGNet2021.03	20.78	12.95	37.05	24.8	18.05	18.35	17.45	16.8
SRAN2021.03	15.56	18.35	38.8	17.4	5.5	8.05	9.45	11.35
CNN2021.03	14.78	13.8	18.25	14.55	14.35	13.75	13.35	15.4
LSTM2023.03	13.1	13.2	14.1	13.7	12.2	13	12.8	12.4
LSTM2021.03	12.81	12.7	13.8	12.9	12.45	13.3	12.4	12.1
LEN2021.03	12.29	11.85	41.4	12.95	5.55	6.35	3.95	3.95
WREN2021.03	9.86	8.65	29.6	9.75	5.7	5.9	4.4	5