Targeted Syntactic Evaluation on Marvin and Linzen 2018 benchmark leaderboard · SOTA2 Research

Targeted Syntactic Evaluation on Marvin and Linzen 2018

99SR SV Agreement: SimpleON-LSTM

Updated 5mo ago

Evaluation Results

Method	Links
ON-LSTM2020.05		99	95	89	84	78	89	86	18	50	7	74	67	66	57	54	57	59	20	11	2.94
SDRNN2020.05		97	92	77	74	71	73	65	1	50	38	62	54	55	58	60	66	48	37	30	3.68
GRU2020.05		95	86	87	75	67	85	78	51	66	67	80	75	67	51	50	58	55	29	20	3
DRNN2020.05		95	89	73	77	74	75	68	25	54	45	55	56	53	64	65	62	32	50	10	3.52
LSTM2020.05		92	93	85	87	75	85	83	56	48	55	80	60	67	55	51	57	55	22	3	3.31
Ab-DRNN2020.05		90	85	69	63	62	63	62	29	51	31	51	53	52	57	59	58	57	36	11	4.73
SRN2020.05		88	84	50	59	57	51	56	1	70	11	51	51	52	51	50	51	87	2	10	5.94