Story Understanding on STORYWARS (test) benchmark leaderboard · SOTA2 Research

Story Understanding on STORYWARS (test)

86.79Genre F1: animalsInstructStory

Updated 5mo ago

Evaluation Results

Method	Links
InstructStory2023.05		86.79	50.98	53.33	78.26	84.96	47.4	51.97	66.07	63.55	66.67	61.88	67.18	64.81	68.22	59.38	68.22	78.85	87.23	78	73.79	68.97	70.79	23.57	79.04	68.72	68.82	63.26	47.33	59.62
RoBERTa2023.05		86.02	47.37	55.64	68.97	85.71	45.3	51.47	62.26	57.14	61.07	61.15	69.57	54.74	81.13	55.56	81.13	72.94	84.78	83.67	69.77	70.1	72.31	23.41	77.74	62.97	75.74	66.6	47.28	59.43
T52023.05		82.88	47.95	52.05	70.59	81.97	44.21	47.48	63.41	52.23	62.69	60.15	60.4	48.52	56.21	37.04	56.21	73.27	86.32	67.89	63.24	53.62	62.03	22.94	78.51	67.2	67.35	63.15	46.87	57.56
BERT2023.05		82.69	43.7	45.67	59.77	78.9	42.67	43.58	55.28	43.48	65.42	51.86	66.67	50.94	61.82	52.17	61.82	67.27	82.61	78.85	72.09	50	64.52	23.19	72.9	65.03	53.54	55.34	31.38	51.9
DeBERTa2023.05		82.24	48.75	60.15	76	79.65	46.43	48.53	67.27	61.16	67.24	62.2	62.02	58.02	62.3	58.49	62.3	81.82	86	59.38	69.23	68.57	69.08	23.17	80.18	67.61	60.81	56.02	41.09	57.39