General AI Assistant Reasoning on GAIA (Web)
63.33AccuracyClaude-3.7
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Claude-3.7Backbone=Claude-3.7-Sonnet, Feedback Rounds=42026.01 | 63.33 | 11.11 | 12.22 | |
| Claude-3.7Backbone=Claude-3.7-Sonnet, Feedback Rounds=62026.01 | 62.22 | 11.11 | 12.22 | |
| Claude-3.7Backbone=Claude-3.7-Sonnet, Feedback Rounds=102026.01 | 62.22 | 11.11 | 12.22 | |
| Claude-3.7Backbone=Claude-3.7-Sonnet, Feedback Rounds=82026.01 | 61.11 | 11.11 | 12.22 | |
| Claude-3.7Backbone=Claude-3.7-Sonnet, Feedback Rounds=22026.01 | 58.89 | 11.11 | 12.22 | |
| Claude-3.7Backbone=Claude-3.7-Sonnet, Feedback Rounds=02026.01 | 51.11 | 11.11 | 12.22 | |
| DeepVerifier-8BBackbone=Llama-3-8B-Base, Feedback Rounds=82026.01 | 33.33 | 6.67 | 6.67 | |
| DeepVerifier-8BBackbone=Llama-3-8B-Base, Feedback Rounds=102026.01 | 33.33 | 6.67 | 6.67 | |
| GPT-4.1Backbone=GPT-4.1, Feedback Rounds=22026.01 | 32.22 | 2.22 | 3.33 | |
| GPT-4.1Backbone=GPT-4.1, Feedback Rounds=62026.01 | 32.22 | 2.22 | 3.33 | |
| DeepVerifier-8BBackbone=Llama-3-8B-Base, Feedback Rounds=62026.01 | 32.22 | 6.67 | 6.67 | |
| GPT-4.1Backbone=GPT-4.1, Feedback Rounds=42026.01 | 31.11 | 2.22 | 3.33 | |
| GPT-4.1Backbone=GPT-4.1, Feedback Rounds=82026.01 | 31.11 | 2.22 | 3.33 | |
| GPT-4.1Backbone=GPT-4.1, Feedback Rounds=102026.01 | 31.11 | 2.22 | 3.33 | |
| DeepVerifier-8BBackbone=Llama-3-8B-Base, Feedback Rounds=22026.01 | 31.11 | 6.67 | 6.67 | |
| DeepVerifier-8BBackbone=Llama-3-8B-Base, Feedback Rounds=42026.01 | 31.11 | 6.67 | 6.67 | |
| GPT-4.1Backbone=GPT-4.1, Feedback Rounds=02026.01 | 28.89 | 2.22 | 3.33 | |
| DeepVerifier-8BBackbone=Llama-3-8B-Base, Feedback Rounds=02026.01 | 26.67 | 6.67 | 6.67 |