P&ID Question Answering on Proteus Context XML
89Response AccuracyGPT-5
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-5Model Provider=OpenAI2026.03 | 89 | 0.175 | — | |
| GPT-5-miniModel Provider=OpenAI2026.03 | 88 | 0.034 | — | |
| Claude-3-7-SonnetModel Provider=Anthropic2026.03 | 81 | 0.464 | — | |
| Claude-Sonnet-4Model Provider=Anthropic2026.03 | 81 | 0.465 | — | |
| Claude-Opus-4-1Model Provider=Anthropic2026.03 | 78 | 2.077 | — | |
| Claude-3-5-HaikuModel Provider=Anthropic2026.03 | 76 | 0.123 | — | |
| GPT-4oModel Provider=OpenAI2026.03 | 73 | 0.286 | — | |
| GPT-4o-miniModel Provider=OpenAI2026.03 | 71 | 0.017 | — |