Markush Enumeration on BIOVISTA
74.3RecallBIOMINER-INSTRUCT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BIOMINER-INSTRUCTCoreference Status (with/without)=without2026.04 | 74.3 | 71.9 | 73.1 | |
| BIOMINER-INSTRUCTCoreference Status (with/without)=with2026.04 | 70.9 | 68.7 | 69.8 | |
| Qwen3-VL-235BCoreference Status (with/without)=without2026.04 | 65.5 | 61.8 | 63.6 | |
| Gemini 2.0-flashCoreference Status (with/without)=without2026.04 | 62.8 | 59.4 | 61.1 | |
| Qwen3-VL-235BCoreference Status (with/without)=with2026.04 | 61.1 | 57.6 | 59.3 | |
| Gemini 2.0-flashCoreference Status (with/without)=with2026.04 | 57.9 | 54.5 | 56.1 | |
| Qwen3-VL-32BCoreference Status (with/without)=without2026.04 | 42.2 | 42.2 | 42.2 | |
| Claude haiku-4-5Coreference Status (with/without)=without2026.04 | 38 | 36.3 | 37.1 | |
| Qwen3-VL-32BCoreference Status (with/without)=with2026.04 | 37.5 | 36.9 | 37.2 | |
| Claude haiku-4-5Coreference Status (with/without)=with2026.04 | 30.9 | 28.9 | 29.9 | |
| GPT-4.1-miniCoreference Status (with/without)=without2026.04 | 25.5 | 28.7 | 27 | |
| Grok-4-fastCoreference Status (with/without)=without2026.04 | 22.3 | 21.2 | 21.7 | |
| GPT-4.1-miniCoreference Status (with/without)=with2026.04 | 21.9 | 22 | 21.9 | |
| Grok-4-fastCoreference Status (with/without)=with2026.04 | 16.8 | 16.2 | 16.5 | |
| GPT-4o-miniCoreference Status (with/without)=without2026.04 | 5 | 5.8 | 5.4 | |
| GPT-4o-miniCoreference Status (with/without)=with2026.04 | 3.9 | 4.1 | 4 |