Grounded Situation Recognition on SWiG v1 (dev) benchmark leaderboard · SOTA2 Research

Grounded Situation Recognition on SWiG v1 (dev)

58.19Top-1 Predicted Verb AccuracyClipSitu XTF

Evaluation Results

Method	Links
ClipSitu XTF2023.07		58.19	47.23	29.73	41.3	13.92	85.69	68.42	41.42	49.23	23.45	78.52	45.31	55.36	32.37
CoFormer2023.07		44.41	35.87	22.47	29.37	12.94	72.98	57.58	34.09	46.7	19.06	76.17	42.11	61.15	23.09
SituFormer2023.07		44.32	35.35	22.1	29.17	13.33	71.01	55.85	33.38	45.78	19.77	76.08	42.15	61.82	24.65
Kernel GraphNet2020.03		43.21	35.18	19.46	—	—	68.55	56.32	30.56	—	—	73.14	41.48	—	—
Kernel GraphNet2023.07		43.21	35.18	19.46	—	—	68.55	56.32	30.56	—	—	73.14	41.68	—	—
GSRTR2023.07		41.06	32.52	19.63	26.04	10.44	69.46	53.69	30.66	42.61	15.98	74.27	39.24	58.33	20.19
JSL2020.03		39.6	31.18	18.85	25.03	10.16	67.71	52.06	29.73	41.25	15.07	73.53	38.32	57.5	19.29
JSL2023.07		39.6	31.18	18.85	25.03	10.16	67.71	52.06	29.73	41.25	15.07	73.53	38.32	57.5	19.29
Updated RNN2020.03		38.83	30.47	18.23	—	—	65.74	50.29	28.59	—	—	72.77	37.49	—	—
ISL2020.03		38.83	30.47	18.23	22.47	7.64	65.74	50.29	28.59	36.9	11.66	72.77	37.49	52.92	15
ISL2023.07		38.83	30.47	18.23	22.47	7.64	65.74	50.29	28.59	36.9	11.66	72.77	37.49	52.92	15
CAQ2023.07		37.96	30.15	18.58	—	—	64.99	50.3	29.17	—	—	73.62	38.71	—	—
GraphNet2020.03		36.93	27.52	19.15	—	—	61.8	45.23	29.98	—	—	68.89	41.07	—	—
GraphNet2023.07		36.93	27.52	19.15	—	—	61.8	45.23	29.98	—	—	68.89	41.07	—	—
RNN w/ Fusion2020.03		36.11	27.74	16.6	—	—	63.11	47.09	26.48	—	—	70.48	35.56	—	—
RNN w/ Fusion2023.07		36.11	27.74	16.6	—	—	63.11	47.09	26.48	—	—	70.48	35.56	—	—
RNN w/o Fusion2020.03		35.35	26.8	15.77	—	—	61.42	44.84	24.31	—	—	68.44	32.98	—	—
CRF+Aug2020.03		34.2	25.39	15.61	—	—	62.21	46.72	25.66	—	—	70.8	34.82	—	—
CRF w/ DataAug2023.07		34.2	26.56	15.61	—	—	62.21	46.72	25.66	—	—	70.8	34.82	—	—
CRF2020.03		32.25	24.56	14.28	—	—	58.64	42.68	22.75	—	—	65.9	29.5	—	—
CRF2023.07		32.25	24.56	14.28	—	—	58.64	42.68	22.75	—	—	65.9	29.5	—	—