Structural Property Extraction on 50 papers structural property dataset
93.8Lattice Structure PrecisionStructPropAgent
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| StructPropAgentBackbone=GPT-4.1 Mini2025.09 | 93.8 | 93.8 | 93.8 | 92.5 | 92.5 | 92.5 | 56.2 | 56.2 | 56.2 | 80.8 | 80.8 | 80.8 | |
| StructPropAgentBackbone=GPT-4.12025.09 | 93.1 | 93.1 | 93.1 | 88 | 88 | 88 | 63.9 | 63.9 | 63.9 | 81.7 | 81.7 | 81.7 | |
| StructPropAgentBackbone=Gemini 2.0 Flash2025.09 | 88.9 | 88.9 | 88.9 | 70.7 | 70.7 | 70.7 | 62.8 | 62.8 | 62.8 | 74.1 | 74.1 | 74.1 | |
| StructPropAgentBackbone=Gemini 1.5 Pro2025.09 | 88.2 | 88.2 | 88.2 | 79.5 | 79.5 | 79.5 | 50.6 | 50.6 | 50.6 | 72.8 | 72.8 | 72.8 |