# Geometry Calculation on UniGeo 1.0 (Calculation)

Source: [Geometry Calculation on UniGeo 1.0 (Calculation)](<https://www.sota2.com/research/sota/geometry-calculation-on-unigeo-1-0-calculation>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:54:24.473Z

Evaluation of model performance on geometry calculation tasks using the UniGeo 1.0 (Calculation) dataset, reporting overall accuracy along with specific scores for Angle and Length measurements.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Geometry Calculation |
| Dataset (including any stated split) | UniGeo 1.0 (Calculation) |
| Metric | Overall Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 22 of 22 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Overall Accuracy](<https://www.sota2.com/research/sota/geometry-calculation-on-unigeo-1-0-calculation.md?metric=Overall%20Accuracy>): Higher is better; unit: PERCENT.

- [Angle Accuracy](<https://www.sota2.com/research/sota/geometry-calculation-on-unigeo-1-0-calculation.md?metric=Angle%20Accuracy>): Higher is better; unit: PERCENT.

- [Length Accuracy](<https://www.sota2.com/research/sota/geometry-calculation-on-unigeo-1-0-calculation.md?metric=Length%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Overall Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| GAPS | 67.8 | Not recorded | 68fa72021e209131cea541bc |
| GAPS | 65.4 | Not recorded | 68fa72021e209131cea541bc |
| Geoformer + Pretraining | 62.5 | Not recorded | 68fa6e1f1e209131cea3df02 |
| Geoformer | 62.5 | Not recorded | 68fa72021e209131cea541bc |
| Geoformer | 60.9 | Not recorded | 68fa6e1f1e209131cea3df02 |
| Geoformer | 60.3 | Not recorded | 68fa6e1f1e209131cea3df02 |
| Geoformer | 60.3 | Not recorded | 68fa72021e209131cea541bc |
| NGS | 56.9 | Not recorded | 68fa6e1f1e209131cea3df02 |
| NGS | 56.9 | Not recorded | 68fa72021e209131cea541bc |
| BERT | 54.7 | Not recorded | 68fa6e1f1e209131cea3df02 |
| BERT2Prog | 54.7 | Not recorded | 68fa72021e209131cea541bc |
| Seq2Prog | 54.2 | Not recorded | 68fa72021e209131cea541bc |
| BERT | 52 | Not recorded | 68fa6e1f1e209131cea3df02 |
| BERT2Prog | 52 | Not recorded | 68fa72021e209131cea541bc |
| NGS | 51.9 | Not recorded | 68fa6e1f1e209131cea3df02 |
| NGS | 51.9 | Not recorded | 68fa72021e209131cea541bc |
| MCAN | 39.7 | Not recorded | 68fa6e1f1e209131cea3df02 |
| MCAN | 39.7 | Not recorded | 68fa72021e209131cea541bc |
| RN | 38 | Not recorded | 68fa6e1f1e209131cea3df02 |
| RN | 38 | Not recorded | 68fa72021e209131cea541bc |
| FiLM | 31.7 | Not recorded | 68fa6e1f1e209131cea3df02 |
| FiLM | 31.7 | Not recorded | 68fa72021e209131cea541bc |

### GAPS

Overall Accuracy: 67.8. Result ID: 699202783a6c3148490c056a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72021e209131cea541bc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72021e209131cea541bc.md>)

Recorded evaluation configuration: {"Training Data":"UniGeo"}. This record does not assert independent reproduction.

### GAPS

Overall Accuracy: 65.4. Result ID: 699202783a6c3148490c0566.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72021e209131cea541bc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72021e209131cea541bc.md>)

Recorded evaluation configuration: {"Training Data":"CAL"}. This record does not assert independent reproduction.

### Geoformer + Pretraining

Overall Accuracy: 62.5. Result ID: 699005313a6c314849fd84c6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Implementation](<https://github.com/chen-judge/UniGeo>)

Recorded evaluation configuration: {"Data Setting":"UniGeo","Pre-training":true}. This record does not assert independent reproduction.

### Geoformer

Overall Accuracy: 62.5. Result ID: 699202783a6c3148490c0569.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72021e209131cea541bc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Implementation](<https://github.com/chen-judge/UniGeo>)

Recorded evaluation configuration: {"Training Data":"UniGeo"}. This record does not assert independent reproduction.

### Geoformer

Overall Accuracy: 60.9. Result ID: 699005313a6c314849fd84c5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Implementation](<https://github.com/chen-judge/UniGeo>)

Recorded evaluation configuration: {"Data Setting":"UniGeo"}. This record does not assert independent reproduction.

### Geoformer

Overall Accuracy: 60.3. Result ID: 699005313a6c314849fd84c2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Implementation](<https://github.com/chen-judge/UniGeo>)

Recorded evaluation configuration: {"Data Setting":"Calculation"}. This record does not assert independent reproduction.

### Geoformer

Overall Accuracy: 60.3. Result ID: 699202783a6c3148490c0565.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72021e209131cea541bc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Implementation](<https://github.com/chen-judge/UniGeo>)

Recorded evaluation configuration: {"Training Data":"CAL"}. This record does not assert independent reproduction.

### NGS

Overall Accuracy: 56.9. Result ID: 699005313a6c314849fd84c1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b9b1e209131cea2f442.md>)

[Implementation](<https://github.com/chen-judge/GeoQA>)

Recorded evaluation configuration: {"Data Setting":"Calculation"}. This record does not assert independent reproduction.

### NGS

Overall Accuracy: 56.9. Result ID: 699202783a6c3148490c0564.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72021e209131cea541bc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Implementation](<https://github.com/chen-judge/UniGeo>)

Recorded evaluation configuration: {"Training Data":"CAL"}. This record does not assert independent reproduction.

### BERT

Overall Accuracy: 54.7. Result ID: 699005313a6c314849fd84c0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Data Setting":"Calculation"}. This record does not assert independent reproduction.

### BERT2Prog

Overall Accuracy: 54.7. Result ID: 699202783a6c3148490c0563.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72021e209131cea541bc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Implementation](<https://github.com/chen-judge/UniGeo>)

Recorded evaluation configuration: {"Training Data":"CAL"}. This record does not assert independent reproduction.

### Seq2Prog

Overall Accuracy: 54.2. Result ID: 699202783a6c3148490c0562.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72021e209131cea541bc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b9b1e209131cea2f442.md>)

[Implementation](<https://github.com/chen-judge/GeoQA>)

Recorded evaluation configuration: {"Training Data":"CAL"}. This record does not assert independent reproduction.

### BERT

Overall Accuracy: 52. Result ID: 699005313a6c314849fd84c3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Data Setting":"UniGeo"}. This record does not assert independent reproduction.

### BERT2Prog

Overall Accuracy: 52. Result ID: 699202783a6c3148490c0567.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72021e209131cea541bc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Implementation](<https://github.com/chen-judge/UniGeo>)

Recorded evaluation configuration: {"Training Data":"UniGeo"}. This record does not assert independent reproduction.

### NGS

Overall Accuracy: 51.9. Result ID: 699005313a6c314849fd84c4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b9b1e209131cea2f442.md>)

[Implementation](<https://github.com/chen-judge/GeoQA>)

Recorded evaluation configuration: {"Data Setting":"UniGeo"}. This record does not assert independent reproduction.

### NGS

Overall Accuracy: 51.9. Result ID: 699202783a6c3148490c0568.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72021e209131cea541bc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Implementation](<https://github.com/chen-judge/UniGeo>)

Recorded evaluation configuration: {"Training Data":"UniGeo"}. This record does not assert independent reproduction.

### MCAN

Overall Accuracy: 39.7. Result ID: 699005313a6c314849fd84bf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65f11e209131cea0d447.md>)

[Implementation](<https://github.com/MILVLG/mcan-vqa>)

Recorded evaluation configuration: {"Data Setting":"Calculation"}. This record does not assert independent reproduction.

### MCAN

Overall Accuracy: 39.7. Result ID: 699202783a6c3148490c0561.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72021e209131cea541bc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Implementation](<https://github.com/chen-judge/UniGeo>)

Recorded evaluation configuration: {"Training Data":"CAL"}. This record does not assert independent reproduction.

### RN

Overall Accuracy: 38. Result ID: 699005313a6c314849fd84be.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63631e209131ce9fe4f0.md>)

[Implementation](<https://www.youtube.com/channel/UCIAnkrNn45D0MeYwtVpmbUQ>)

Recorded evaluation configuration: {"Data Setting":"Calculation"}. This record does not assert independent reproduction.

### RN

Overall Accuracy: 38. Result ID: 699202783a6c3148490c0560.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72021e209131cea541bc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Implementation](<https://github.com/chen-judge/UniGeo>)

Recorded evaluation configuration: {"Training Data":"CAL"}. This record does not assert independent reproduction.

### FiLM

Overall Accuracy: 31.7. Result ID: 699005313a6c314849fd84bd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63ee1e209131cea0190e.md>)

[Implementation](<https://github.com/ethanjperez/film>)

Recorded evaluation configuration: {"Data Setting":"Calculation"}. This record does not assert independent reproduction.

### FiLM

Overall Accuracy: 31.7. Result ID: 699202783a6c3148490c055f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72021e209131cea541bc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e1f1e209131cea3df02.md>)

[Implementation](<https://github.com/chen-judge/UniGeo>)

Recorded evaluation configuration: {"Training Data":"CAL"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
