CAPTCHA Solving on Next-Gen CAPTCHAs benchmark leaderboard · SOTA2 Research

CAPTCHA Solving on Next-Gen CAPTCHAs

98.8Avg Pass@1Human

Evaluation Results

Method
Human2026.02	98.8	—	100	100	100	100	100	100	100	90	100	100	100	100	100	90	100	100	100	100	100	100	100	90	100	100	100	100	100
GPT-5.2 xHigh2026.02	5.9	3,122.3	0	20	20	40	0	0	0	0	0	0	0	0	0	20	0	20	0	20	20	0	0	0	0	0	0	0	0
Gemini-3 Flash-High2026.02	3.2	6.5	0	0	0	5	15	0	0	0	0	0	0	0	10	18.2	0	0	15	0	0	12.5	0	0	0	5	0	0	5
Claude-Opus4.5 Extend-ThinkingHigh2026.02	3	224	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	20	0	0	0	0	0	0	0	0	60	0
Gemini-3 Pro-High2026.02	1.3	50.1	0	0	0	0	0	0	0	5	0	0	0	0	0	9.1	0	5	0	0	0	0	5	0	0	10	0	0	0
Doubao-Seed-1.8 Thinking-HighEffort2026.02	1.3	26.6	0	0	0	0	5	0	0	0	0	0	0	0	0	9.1	0	15	0	0	0	0	0	0	0	0	0	0	5
Qwen3-VL-Plus ThinkingHigh2026.02	0.9	28.3	0	0	0	5	15	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	5	0	0	0