Domain-Specific Applied Tasks on Multi-Domain Contexts (Education, CS Q&A, IE)
69Pass@1Seed1.8
Evaluation results
| Method | Links | |
|---|---|---|
| Seed1.8Dataset=Customer Support Q&A2026.03 | 69 | |
| Gemini 3-proDataset=Customer Support Q&A2026.03 | 65.5 | |
| Gemini 3-proDataset=Intention Recognition2026.03 | 65.3 | |
| Gemini 2.5-proDataset=Customer Support Q&A2026.03 | 64.6 | |
| GPT-5 HighDataset=Intention Recognition2026.03 | 63.8 | |
| GPT-5 HighDataset=Customer Support Q&A2026.03 | 63.4 | |
| Seed1.8Dataset=Intention Recognition2026.03 | 63.2 | |
| Claude Sonnet-4.5Dataset=Intention Recognition2026.03 | 62.7 | |
| Seed1.8Dataset=Education2026.03 | 60.8 | |
| Claude Sonnet-4.5Dataset=Customer Support Q&A2026.03 | 59.4 | |
| Gemini 2.5-proDataset=Intention Recognition2026.03 | 58.3 | |
| Gemini 3-proDataset=Complex Workflow2026.03 | 58.2 | |
| Gemini 3-proDataset=Education2026.03 | 57 | |
| Gemini 3-proDataset=Information Processing2026.03 | 56.5 | |
| Claude Sonnet-4.5Dataset=Complex Workflow2026.03 | 55.4 | |
| GPT-5 HighDataset=Education2026.03 | 55 | |
| Claude Sonnet-4.5Dataset=Information Processing2026.03 | 55 | |
| Seed1.8Dataset=Complex Workflow2026.03 | 54.6 | |
| Gemini 2.5-proDataset=Complex Workflow2026.03 | 54.4 | |
| GPT-5 HighDataset=Information Processing2026.03 | 54.3 | |
| Seed1.8Dataset=Information Processing2026.03 | 53.9 | |
| Claude Sonnet-4.5Dataset=Education2026.03 | 53 | |
| GPT-5 HighDataset=Complex Workflow2026.03 | 53 | |
| Gemini 2.5-proDataset=Education2026.03 | 52.4 | |
| Gemini 2.5-proDataset=Information Processing2026.03 | 52.4 | |
| Claude Sonnet-4.5Dataset=Information Extraction2026.03 | 46.9 | |
| GPT-5 HighDataset=Information Extraction2026.03 | 46.1 | |
| Gemini 3-proDataset=Information Extraction2026.03 | 46 | |
| Gemini 2.5-proDataset=Information Extraction2026.03 | 44.6 | |
| Seed1.8Dataset=Information Extraction2026.03 | 43.7 |