P&ID Question Answering on Multimodal Context Flowsheet Image
83Response AccuracyGPT-5-mini
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-5-miniModel Provider=OpenAI2026.03 | 83 | 0.002 | — | |
| GPT-5Model Provider=OpenAI2026.03 | 76 | 0.01 | — | |
| Claude-Sonnet-4Model Provider=Anthropic2026.03 | 68 | 0.009 | — | |
| Claude-Opus-4-1Model Provider=Anthropic2026.03 | 66 | 0.038 | — | |
| Claude-3-7-SonnetModel Provider=Anthropic2026.03 | 62 | 0.007 | — | |
| Claude-3-5-HaikuModel Provider=Anthropic2026.03 | 59 | 0.002 | — | |
| GPT-4oModel Provider=OpenAI2026.03 | 58 | 0.002 | — | |
| GPT-4o-miniModel Provider=OpenAI2026.03 | 55 | 0.0002 | — |