Geometry Calculation on UniGeo 1.0 (Calculation)
67.8Overall AccuracyGAPS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GAPSTraining Data=UniGeo2024.01 | 67.8 | 78.2 | 54.6 | |
| GAPSTraining Data=CAL2024.01 | 65.4 | 77.7 | 50.4 | |
| Geoformer + PretrainingData Setting=UniGeo, Pre-training=true2022.12 | 62.5 | 75.5 | 48.8 | |
| GeoformerTraining Data=UniGeo2024.01 | 62.5 | 75.5 | 48.8 | |
| GeoformerData Setting=UniGeo2022.12 | 60.9 | 72.2 | 48.8 | |
| GeoformerData Setting=Calculation2022.12 | 60.3 | 71.5 | 49.1 | |
| GeoformerTraining Data=CAL2024.01 | 60.3 | 71.5 | 49.1 | |
| NGSData Setting=Calculation2022.12 | 56.9 | 69.8 | 39.2 | |
| NGSTraining Data=CAL2024.01 | 56.9 | 71.5 | 49.1 | |
| BERTData Setting=Calculation2022.12 | 54.7 | 65.8 | 42.1 | |
| BERT2ProgTraining Data=CAL2024.01 | 54.7 | 65.8 | 42.1 | |
| Seq2ProgTraining Data=CAL2024.01 | 54.2 | 66.4 | 38.5 | |
| BERTData Setting=UniGeo2022.12 | 52 | 63.1 | 39.2 | |
| BERT2ProgTraining Data=UniGeo2024.01 | 52 | 63.1 | 39.2 | |
| NGSData Setting=UniGeo2022.12 | 51.9 | 63.6 | 38.8 | |
| NGSTraining Data=UniGeo2024.01 | 51.9 | 63.6 | 38.8 | |
| MCANData Setting=Calculation2022.12 | 39.7 | 45 | 34.6 | |
| MCANTraining Data=CAL2024.01 | 39.7 | 45 | 34.6 | |
| RNData Setting=Calculation2022.12 | 38 | 42.8 | 32.5 | |
| RNTraining Data=CAL2024.01 | 38 | 42.8 | 32.5 | |
| FiLMData Setting=Calculation2022.12 | 31.7 | 34 | 29.7 | |
| FiLMTraining Data=CAL2024.01 | 31.7 | 34 | 29.7 |