Multimodal Retrieval and Understanding on MMEB V2 (test)

76.7Image CLS AccIFM-TTE

Evaluation Results

Method
IFM-TTE2026.01	76.7	78.5	74.6	89.3	77.9	60.5	67.9	51.7	54.9	59.2	85.2	71.5	92.7	53.3	79.5	74.1
IFM-TTE2026.04	76.7	78.5	74.6	89.3	77.9	60.5	67.9	51.7	54.9	59.2	85.2	71.5	92.8	33.7	76.2	73.1
Seed-1.6-embedding-06152026.01	76.1	74	77.9	91.3	77.8	55	60.8	51.3	53.5	55.3	85.3	56.6	84.7	68.6	77.7	72.6
Seed-1.6-embedding-12152026.01	75	74.9	79.3	89	78	85.2	66.7	59.1	54.8	67.7	90	60.3	90	70.7	82.2	76.9
Qwen3-VL-Embedding-8B2026.01	74.2	81.1	80.2	92.3	80.1	78.4	71	58.7	56.1	67.1	87.2	69.9	88.7	73.3	82.4	77.8
RzenEmbed2026.01	70.6	71.7	78.5	92.1	75.9	58.8	63.5	51	45.5	55.7	89.7	60.7	88.7	69.9	81.3	72.9
RzenEmbed-V22026.04	70.6	71.7	78.5	92.1	75.9	58.8	63.5	51	45.5	55.7	89.7	60.7	88.7	44.4	77.1	71.6
Qwen3-VL-Embedding-2B2026.01	70.3	74.3	74.8	88.5	75	71.9	64.9	53.9	53.3	61.9	84.4	65.3	86.4	69.4	79.2	73.2
Ops-MM-embedding-v12026.01	69.7	69.6	73.1	87.2	72.7	59.7	62.2	45.7	43.2	53.8	80.1	59.6	79.3	67.8	74.4	68.9
RzenEmbed2026.01	68.5	66.3	74.5	90.3	72.3	50.4	49.7	46.6	38.9	47.3	87.1	55.1	87.2	43.4	74.5	67.2
Ops-MM-embedding-v12026.01	68.1	65.1	69.2	80.9	69	53.6	55.6	41.8	33.7	47.6	76.4	53.2	77.6	64.2	70.8	64.6
TTEs2026.05	67.9	66.6	70.2	84.1	70.1	47.3	49.1	34.4	33.2	32.1	77.5	53.2	83.2	41.1	68.8	63.1
UME-R12026.04	67.1	69.2	71.9	84.9	71.3	48.6	60.7	38.2	39.3	47.5	75.7	50.5	83.7	29.2	65.7	64.1
TTE-Flash2026.05	67.1	61.7	70.7	81.3	68.3	54.4	51.5	45.4	51.5	50.6	75.6	52.7	83.8	41.1	68.1	64.1
PLUME2026.05	66.5	59.2	67.6	79.7	66.3	45	52.3	33.5	46.7	44.1	72.1	49.8	78.1	57.4	67.5	61.6
VLM2Vec-V22026.05	65.7	61.5	70	85.2	68.1	45.9	33.9	27.6	39.3	36.4	78.8	52.6	82.7	42.1	69.3	61.2
UniME-V22026.04	65.6	68.7	73.1	90.9	71.8	37.2	50.6	28.9	39.6	39	61.8	42	70.5	37.9	56.7	59.6
RzenEmbed-V12026.04	65.3	61.7	73.8	77.9	68.5	45.6	47.5	38.3	36.7	42.6	87	57.6	85.4	43.3	74.4	64.4
CAFe2026.04	65.2	65.6	70	91.2	67.6	35.8	58.7	34.4	39.5	42.4	70.7	49.6	79.5	38.1	63.9	60.6
UME-R12026.05	64.8	62.8	67.6	77.2	66.6	44.3	51.2	32.9	39.7	42.2	72.4	46.2	79.2	37.2	63.9	60.1
VLM2Vec-V22026.04	64.5	56.2	67.2	74.7	64.2	39.1	34.4	28.2	32	33.6	66	37.1	77.6	32.4	58.5	55.4
BToks2026.04	64.3	59.8	68.8	77.4	66	43.7	47	33	33.6	39.9	71.1	38.6	81.3	38.1	62.7	59
VLM2Vec-V22026.01	62.9	56.3	69.5	77.3	64.9	39.3	34.3	28.8	36.8	34.6	75.5	44.9	79.4	62.2	69.2	59.2
VLM2Vec-V22026.05	62.9	56.3	69.5	77.3	64.9	39.3	34.3	28.8	38.5	34.9	75.5	44.9	79.4	39.4	65.4	58
VLM2Vec2026.01	62.7	56.9	69.4	82.2	65.5	39.1	30	29	38.9	33.7	56.9	9.4	59.1	54	49.1	53.1
DUME2026.05	59.3	55	66.3	78	62.5	37.7	46.6	17.1	30	33.2	67.6	43.3	47.1	33.8	52.8	52.7
LamRA2026.05	59.2	26.5	70	62.7	54.1	39.3	42.6	24.3	34.6	35.2	22	11.5	37.4	21	23.9	40.4
VLM2Vec2026.01	58.7	49.3	65	72.9	59.7	33.4	30.5	20.6	30.7	28.6	49.8	13.5	51.8	48.2	44	47.7
VLM2Vec-V12026.04	58.7	49.3	65	72.9	59.7	33.4	30.5	20.6	30.8	28.6	49.8	13.5	51.8	33.6	41.6	47
GME2026.01	57.7	34.7	71.2	59.3	56	37.4	50.4	28.4	37	38.4	89.4	55.6	85	68.3	79.3	59.1
Gme2026.04	57.7	34.7	71.2	59.3	56	37.4	50.4	28.4	37	38.4	89.4	55.6	85	44.4	75.2	57.8
Gme2026.04	56.9	41.2	67.8	53.4	51.9	34.9	42	25.6	31.1	33.6	86.2	54	82.5	43.1	72.7	54.1
GME2026.01	54.4	29.9	66.9	55.5	51.9	34.9	42	25.6	31.1	33.6	86.1	54	82.5	67.5	76.8	55.3
GME2026.05	54.4	29.9	66.9	55.5	51.9	34.9	42	25.6	32.4	33.9	86.1	54	82.5	43.1	72.7	54.1
LamRA2026.04	51.7	34.1	66.9	56.7	52.4	32.9	42.6	23.2	37.2	33.6	56.3	33.3	58.2	40.1	50.2	47.4
ColPali2026.04	40.3	11.5	48.1	40.3	34.9	26.7	37.8	21.6	25.5	28.2	83.6	52	81.1	43.1	71	44.4
ColPali2026.05	40.3	11.5	48.1	40.3	34.9	26.7	37.8	21.6	25.5	28.2	83.6	52	81.1	43.1	71	44.4