List your company

Video Retrieval on RVMS-Bench 1.0 (test)

64GHuman
8.46422.88237.351.718Feb 10, 2026

Evaluation results

MethodLinks
HumanProtocol=Rule-only baseline2026.0264—282488245664608054.2
HumanProtocol=Model + Rule (RACLO)2026.0264———88——72608072.8
Gemini-3-ProProtocol=Model + Rule (RACLO), Availability=Closed Source2026.0245.6———58.8——63.156.961.257
Gemini-2.5-ProProtocol=Model + Rule (RACLO), Availability=Closed Source2026.0236.2———28.8——34.43024.431
Qwen3-VL-235BProtocol=Model + Rule (RACLO), Availability=Open Source, Version=Instruct2026.0232.5———42.5——4043.82536.6
GPT-5-MiniProtocol=Model + Rule (RACLO), Availability=Closed Source2026.0231.2———27.5——28.828.827.528.8
Qwen2.5-VL-72BProtocol=Model + Rule (RACLO), Availability=Open Source, Version=Instruct2026.0229.4———23.1——33.826.228.828.1
Hunyuan-VideoProtocol=Model + Rule (RACLO), Availability=Closed Source2026.0228.8———22.5——27.523.819.424.4
GPT-5.2Protocol=Model + Rule (RACLO), Availability=Closed Source2026.0226.2———36.9——38.131.236.233.8
Claude-4.5-SonnetProtocol=Model + Rule (RACLO), Availability=Closed Source2026.0223.8———24.4——26.221.923.824
Qwen3-VL-235BProtocol=Rule-only baseline, Availability=Open Source, Version=Instruct2026.0221.9—15.112.413.11516.111.923.13017.6
Gemini-2.5-ProProtocol=Rule-only baseline, Availability=Closed Source2026.0218.8—13.110.61512.513.818.116.217.515.1
GPT-4oProtocol=Model + Rule (RACLO), Availability=Closed Source2026.0218.8———19.4——21.917.518.819.2
Qwen2.5-VL-72BProtocol=Rule-only baseline, Availability=Open Source, Version=Instruct2026.0216.9—11.91011.911.212.517.51516.213.7
GPT-5-MiniProtocol=Rule-only baseline, Availability=Closed Source2026.0216.1—1.91.910.64.44713.813.18.1
Hunyuan-VideoProtocol=Rule-only baseline, Availability=Closed Source2026.0215.6—10.68.812.51011.21513.114.412.4
Gemini-3-ProProtocol=Rule-only baseline, Availability=Closed Source2026.0214.4—23.816.916.92023.831.915.622.520.6
GPT-5.2Protocol=Rule-only baseline, Availability=Closed Source2026.0214.4—3.21.612.96.9513.116.2159.8
Claude-4.5-SonnetProtocol=Rule-only baseline, Availability=Closed Source2026.0212.5—10.68.812.51011.214.411.213.111.6
GPT-4oProtocol=Rule-only baseline, Availability=Closed Source2026.0210.6—7.56.2107.58.111.91011.29.2