List your company

Logical Fallacy Detection on LOGIC-Climate 10% representative subset (107 instances)

302CountGemini 2.5 pro
188.64218.07247.5276.93Jun 20, 2026

Evaluation results

MethodLinks
Gemini 2.5 proMode=Thinking (T), Executor=Claude-sonnet-4.5, Max repair iterations=42026.0630291.7217.8873.840.997.623.310.663.64
GPT-5Mode=Thinking (T), Executor=Claude-sonnet-4.5, Max repair iterations=42026.0629097.5917.9379.660.342.070.691.380
Grok 4 fastMode=Non-Thinking (NT), Executor=Claude-sonnet-4.5, Max repair iterations=42026.0627996.4117.9278.491.082.871.790.360.72
Kimi-k2Mode=Thinking (T), Executor=Claude-sonnet-4.5, Max repair iterations=42026.0627694.218.4875.721.455.430.723.621.09
Qwen3 235BMode=Non-Thinking (NT), Executor=Claude-sonnet-4.5, Max repair iterations=42026.0625994.5922.3972.21.164.251.931.161.16
Gemini 2.5 proMode=Non-Thinking (NT), Executor=Claude-sonnet-4.5, Max repair iterations=42026.0624891.1319.7671.372.026.853.230.43.23
Qwen3 235BMode=Thinking (T), Executor=Claude-sonnet-4.5, Max repair iterations=42026.0623792.420.2572.1507.592.112.952.53
GPT-4oMode=Non-Thinking (NT), Executor=Claude-sonnet-4.5, Max repair iterations=42026.0623696.6122.8873.7303.390.852.540
GPT-oss-120bMode=Thinking (T), Executor=Claude-sonnet-4.5, Max repair iterations=42026.0623497.0120.5176.502.9902.990
Gemini 2.5 flashMode=Thinking (T), Executor=Claude-sonnet-4.5, Max repair iterations=42026.0622989.5221.468.122.627.866.110.441.31
Claude-sonnet-4.5Mode=Thinking (T), Executor=Claude-sonnet-4.5, Max repair iterations=42026.0622793.8422.9170.930.885.292.22.640.44
Grok 4 fastMode=Thinking (T), Executor=Claude-sonnet-4.5, Max repair iterations=42026.0621590.720.9369.770.478.842.335.121.4
Deepseek-r1Mode=Thinking (T), Executor=Claude-sonnet-4.5, Max repair iterations=42026.0620192.0422.3969.650.57.9605.971.99
Gemini 2.5 flashMode=Non-Thinking (NT), Executor=Claude-sonnet-4.5, Max repair iterations=42026.0619590.7722.0568.721.038.213.084.11.03
Deepseek-chat-v3.1Mode=Thinking (T), Executor=Claude-sonnet-4.5, Max repair iterations=42026.0619390.1620.2169.951.049.331.045.72.59