Grounded Situation Recognition on SWiG v1 (dev)

58.19Top-1 Predicted Verb AccuracyClipSitu XTF

Evaluation results

Method
ClipSitu XTF2023.07	58.19	47.23	29.73	41.3	13.92	85.69	68.42	41.42	49.23	23.45	78.52	45.31	55.36	32.37
CoFormer2023.07	44.41	35.87	22.47	29.37	12.94	72.98	57.58	34.09	46.7	19.06	76.17	42.11	61.15	23.09
SituFormer2023.07	44.32	35.35	22.1	29.17	13.33	71.01	55.85	33.38	45.78	19.77	76.08	42.15	61.82	24.65
Kernel GraphNet2020.03	43.21	35.18	19.46	—	—	68.55	56.32	30.56	—	—	73.14	41.48	—	—
Kernel GraphNet2023.07	43.21	35.18	19.46	—	—	68.55	56.32	30.56	—	—	73.14	41.68	—	—
GSRTR2023.07	41.06	32.52	19.63	26.04	10.44	69.46	53.69	30.66	42.61	15.98	74.27	39.24	58.33	20.19
JSL2020.03	39.6	31.18	18.85	25.03	10.16	67.71	52.06	29.73	41.25	15.07	73.53	38.32	57.5	19.29
JSL2023.07	39.6	31.18	18.85	25.03	10.16	67.71	52.06	29.73	41.25	15.07	73.53	38.32	57.5	19.29
Updated RNN2020.03	38.83	30.47	18.23	—	—	65.74	50.29	28.59	—	—	72.77	37.49	—	—
ISL2020.03	38.83	30.47	18.23	22.47	7.64	65.74	50.29	28.59	36.9	11.66	72.77	37.49	52.92	15
ISL2023.07	38.83	30.47	18.23	22.47	7.64	65.74	50.29	28.59	36.9	11.66	72.77	37.49	52.92	15
CAQ2023.07	37.96	30.15	18.58	—	—	64.99	50.3	29.17	—	—	73.62	38.71	—	—
GraphNet2020.03	36.93	27.52	19.15	—	—	61.8	45.23	29.98	—	—	68.89	41.07	—	—
GraphNet2023.07	36.93	27.52	19.15	—	—	61.8	45.23	29.98	—	—	68.89	41.07	—	—
RNN w/ Fusion2020.03	36.11	27.74	16.6	—	—	63.11	47.09	26.48	—	—	70.48	35.56	—	—
RNN w/ Fusion2023.07	36.11	27.74	16.6	—	—	63.11	47.09	26.48	—	—	70.48	35.56	—	—
RNN w/o Fusion2020.03	35.35	26.8	15.77	—	—	61.42	44.84	24.31	—	—	68.44	32.98	—	—
CRF+Aug2020.03	34.2	25.39	15.61	—	—	62.21	46.72	25.66	—	—	70.8	34.82	—	—
CRF w/ DataAug2023.07	34.2	26.56	15.61	—	—	62.21	46.72	25.66	—	—	70.8	34.82	—	—
CRF2020.03	32.25	24.56	14.28	—	—	58.64	42.68	22.75	—	—	65.9	29.5	—	—
CRF2023.07	32.25	24.56	14.28	—	—	58.64	42.68	22.75	—	—	65.9	29.5	—	—