Sentence-pair classification on XNLI 1.1 (test) benchmark leaderboard · SOTA2 Research

Sentence-pair classification on XNLI 1.1 (test)

67.97Accuracy (EN)DPA

Evaluation Results

Method	Links
DPA2022.02		67.97	59.54	63.59	63.26	62.34	64.8	63.93	58.39	61.87	55.83	59.19	60.32	56	62.41	61.29	61.38
UP2022.02		65.08	56.57	61.03	60.65	60.74	59.21	61.01	55.18	59.41	53.73	57.66	57.62	54.08	60.58	58.71	58.75
DPA2022.02		62.57	54.91	58.72	58.81	58.25	59.47	58.76	52.93	57.35	50.95	54.3	54.94	51.47	57.8	54.99	56.42
UP2022.02		60.08	51.31	56.6	55.1	56.17	51.25	56.97	49.62	55.18	48.71	53.87	50.42	49.2	55.03	53.15	53.51
DPA2022.02		59.97	53.18	56.51	56.67	55.63	56.79	56.97	51.77	55.46	50.71	53.35	54.21	50.76	56.05	53.09	54.74
UP2022.02		57.76	51.67	54.85	54.99	54.69	51.63	54.96	47.97	53.32	48.12	51.91	49.89	47.86	54.14	49.13	52.19
UP2022.02		53.33	47.7	50.87	49.74	51.41	41.48	51.09	44.97	50.11	46.76	49.5	45.92	45.64	51	44.33	48.26
DPA2022.02		52.79	49.37	51.48	50.84	51.78	50.05	51.77	48.08	50.46	47.3	49.35	50.14	47.44	50.84	48.25	49.99
DPA w/o MV2022.02		49.54	41.55	46.84	45.53	47.59	34.63	48.55	42.39	47.18	43.95	46.37	43.82	43.32	46.52	40.09	44.52
DPA2022.02		48.55	46.24	47.95	48	47.41	47.47	48.61	44.36	46.76	44.35	45.95	45.83	44.8	47.31	44.55	46.54
DPA w/o Mixup2022.02		48.38	45.59	47.74	47.72	47.6	44.38	47.83	42.44	46.69	44.38	44.65	45.52	43.48	46.65	40.83	45.59
UP2022.02		47.68	42.01	45.5	44.51	46.68	36.61	46.81	40.29	45.43	42.06	44.21	41.04	40.61	45.79	38.42	43.18
PCT2022.02		42.43	35.8	37.48	36.02	40.23	36.14	38.79	39.79	37.96	36.32	39.01	37.41	35.46	38.84	38.9	38.04
FT2022.02		35.62	35.11	34.85	35.07	35.08	35.21	34.95	34.89	34.52	35.07	34.92	34.79	35.02	35.02	34.71	34.99