Data Reasoning on DABStep-R
4.82Content ScoreGemini-2.5-Pro
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Gemini-2.5-ProCategory=Direct inference, Traceability (Comp.)=✗, Traceability (Deriv.)=✗2026.06 | 4.82 | 4.85 | |
| Claude-4.5-SonnetCategory=Direct inference, Traceability (Comp.)=✗, Traceability (Deriv.)=✗2026.06 | 4.8 | 4.64 | |
| Claude-4.5-OpusCategory=Direct inference, Traceability (Comp.)=✗, Traceability (Deriv.)=✗2026.06 | 4.68 | 4.73 | |
| Qwen3-32BCategory=Direct inference, Traceability (Comp.)=✗, Traceability (Deriv.)=✗2026.06 | 4.65 | 4.64 | |
| GPT-5.2Category=Direct inference, Traceability (Comp.)=✗, Traceability (Deriv.)=✗2026.06 | 4.61 | 4.81 | |
| Claude-4.5-SonnetCategory=ReAct data agents, Traceability (Comp.)=✓, Traceability (Deriv.)=✗2026.06 | 4.55 | 4.51 | |
| Qwen3-30B-A3BCategory=Direct inference, Traceability (Comp.)=✗, Traceability (Deriv.)=✗2026.06 | 4.49 | 4.53 | |
| Qwen3-32BCategory=ReAct data agents, Traceability (Comp.)=✓, Traceability (Deriv.)=✗2026.06 | 3.81 | 3.72 | |
| GPT-5.4Category=ReAct data agents, Traceability (Comp.)=✓, Traceability (Deriv.)=✗2026.06 | 3.71 | 3.62 | |
| Claude-4.5-OpusCategory=ReAct data agents, Traceability (Comp.)=✓, Traceability (Deriv.)=✗2026.06 | 3.67 | 3.92 | |
| DeepAnalyzeCategory=Specialized data agents, Traceability (Comp.)=✓, Traceability (Deriv.)=✗2026.06 | 3.61 | 3.93 | |
| Qwen3-8BCategory=ReAct data agents, Traceability (Comp.)=✓, Traceability (Deriv.)=✗2026.06 | 3.39 | 3.41 | |
| VeriGraph-8BCategory=Specialized data agents, Traceability (Comp.)=✓, Traceability (Deriv.)=✓2026.06 | 3.31 | 3.56 | |
| GPT-5.2Category=ReAct data agents, Traceability (Comp.)=✓, Traceability (Deriv.)=✗2026.06 | 3.26 | 3.42 | |
| Qwen3-Coder-30BCategory=ReAct data agents, Traceability (Comp.)=✓, Traceability (Deriv.)=✗2026.06 | 3.21 | 3.52 | |
| QwQ-32BCategory=ReAct data agents, Traceability (Comp.)=✓, Traceability (Deriv.)=✗2026.06 | 3.2 | 3.2 | |
| Qwen3-30B-A3BCategory=ReAct data agents, Traceability (Comp.)=✓, Traceability (Deriv.)=✗2026.06 | 3.09 | 3.21 | |
| DataMindCategory=Specialized data agents, Traceability (Comp.)=✓, Traceability (Deriv.)=✗2026.06 | 2.47 | 2.86 |