Handwritten Mathematical Expression Recognition on CROHME 2014 (test)
82.05Expression Rate (Exp)Uni-MuMER
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Uni-MuMERexternal data=true2025.05 | 82.05 | 85.09 | — | — | — | — | |
| Uni-MuMERzero-shot inference=true, external data used=true2025.05 | 82.05 | — | 89.45 | 93 | — | — | |
| Uni-MuMER2025.05 | 75.36 | 79.11 | — | — | — | — | |
| Uni-MuMERzero-shot inference=true2025.05 | 75.36 | — | 85.09 | 89.05 | — | — | |
| HiE-VLexternal data=true2025.05 | 73.3 | — | — | — | — | — | |
| HiE-VLMzero-shot inference=true, external data used=true2025.05 | 73.3 | — | 84 | 87 | — | — | |
| Vanilla (baseline)reproduced=true2025.05 | 72.62 | 75.66 | — | — | — | — | |
| Vanilla (baseline)zero-shot inference=true2025.05 | 72.62 | — | 81.34 | 86.82 | — | — | |
| UniMERNetdata augmentation=true, external data=true2025.05 | 67.4 | — | — | — | — | — | |
| CAN-ABMData augmentation=true2022.07 | 65.89 | — | 77.97 | 84.16 | — | — | |
| CAN-DWAPData augmentation=true2022.07 | 65.58 | — | 77.36 | 83.35 | — | — | |
| ABM (baseline)Data augmentation=true, Reproduced=true2022.07 | 63.76 | — | 76.35 | 83.05 | — | — | |
| PosFormerdata augmentation=true, reproduced=true2025.05 | 62.74 | 65.88 | — | — | — | — | |
| PosFormerzero-shot inference=true, data augmentation=true2025.05 | 62.68 | — | 79.01 | 84.69 | — | — | |
| PosFormerScale-aug=true2024.07 | 62.68 | — | 79.01 | 84.69 | 88.84 | — | |
| SSANdata augmentation=true, reproduced=true2025.05 | 62.58 | — | — | — | — | — | |
| SSANzero-shot inference=true, data augmentation=true2025.05 | 62.58 | — | — | — | — | — | |
| TAMER2025.05 | 61.36 | 63.28 | — | — | — | — | |
| TAMERzero-shot inference=true2025.05 | 61.36 | — | 76.77 | 83.25 | — | — | |
| TAMERdata augmentation=none2024.08 | 61.23 | — | 76.77 | 83.25 | — | — | |
| SSAN2025.05 | 60.85 | — | — | — | — | — | |
| SSANzero-shot inference=true2025.05 | 60.85 | — | 75.56 | 82.25 | — | — | |
| BPD-CoverageScale-aug=true2024.07 | 60.65 | — | — | — | — | — | |
| ICAL2025.05 | 60.63 | — | — | — | — | — | |
| ICAL2024.05 | 60.63 | — | 75.99 | 82.8 | — | — | |
| ICALdata augmentation=none2024.08 | 60.63 | — | 75.99 | 82.8 | — | — | |
| NAMERdata augmentation=none2024.08 | 60.51 | — | 75.03 | 82.25 | — | — | |
| PosFormer2025.05 | 60.45 | — | — | — | — | — | |
| PosFormerzero-shot inference=true2025.05 | 60.45 | — | 77.28 | 83.68 | — | — | |
| PosFormerScale-aug=false2024.07 | 60.45 | — | 77.28 | 83.68 | 87.83 | — | |
| VLPGzero-shot inference=true, external data used=true2025.05 | 60.41 | — | 74.14 | 78.9 | — | — | |
| VLPGexternal data=true2025.05 | 60.31 | — | — | — | — | — | |
| GCNsupplementary_information=true2024.05 | 60 | — | — | — | — | — | |
| GCNdata augmentation=none2024.08 | 60 | — | — | — | — | — | |
| Qwen2.5-VL-72Bzero-shot=true2025.05 | 59.74 | 68.56 | — | — | — | — | |
| Qwen2.5-VL-72Bzero-shot inference=true2025.05 | 59.74 | — | 70.39 | 78.4 | — | — | |
| COMERreproduced=true2025.05 | 59.33 | — | — | — | — | — | |
| COMERzero-shot inference=true, reproduced=true2025.05 | 59.33 | — | 71.7 | 75.66 | — | — | |
| CoMER2022.07 | 59.33 | — | 71.7 | 75.66 | 77.89 | — | |
| COMERScale-aug=true2024.07 | 59.33 | — | 71.7 | 75.66 | 77.89 | — | |
| Ding et al.2022.07 | 58.72 | — | — | — | — | — | |
| Ding et al.Data augmentation=true2022.07 | 58.72 | — | — | — | — | — | |
| COMER2025.05 | 58.38 | 61.66 | — | — | — | — | |
| COMERzero-shot inference=true2025.05 | 58.38 | — | 74.48 | 81.14 | — | — | |
| CoMERreproduced=true2024.05 | 58.38 | — | 74.48 | 81.14 | — | — | |
| CoMERdata augmentation=none, reproduced=true2024.08 | 58.38 | — | 74.48 | 81.14 | — | — | |
| Gemini2.5-flashzero-shot=true2025.05 | 58.01 | 69.98 | — | — | — | — | |
| Gemini 1.5-flashzero-shot inference=true2025.05 | 58.01 | — | 71.6 | 81.14 | — | — | |
| DWAP (baseline)Data augmentation=true, Reproduced=true2022.07 | 57.97 | — | 73.81 | 79.19 | — | — | |
| CAN-ABM2025.05 | 57.26 | — | — | — | — | — | |
| CAN-ABMzero-shot inference=true2025.05 | 57.26 | — | 74.52 | 82.03 | — | — | |
| CAN-ABMData augmentation=false2022.07 | 57.26 | — | 74.52 | 82.03 | — | — | |
| CANScale-aug=false2024.07 | 57.26 | — | 74.52 | 82.03 | — | — | |
| CAN-ABM2024.05 | 57.26 | — | 74.52 | 82.03 | — | — | |
| CAN-ABMdata augmentation=none2024.08 | 57.26 | — | 74.52 | 82.03 | — | — | |
| CAN-DWAPData augmentation=false2022.07 | 57 | — | 74.21 | 80.61 | — | — | |
| CAN-DWAP2024.05 | 57 | — | 74.21 | 80.61 | — | — | |
| CAN-DWAPdata augmentation=none2024.08 | 57 | — | 74.21 | 80.61 | — | — | |
| ABM2025.05 | 56.85 | — | — | — | — | — | |
| ABMzero-shot inference=true2025.05 | 56.85 | — | 73.73 | 80.61 | — | — | |
| ABM2021.12 | 56.85 | — | 73.73 | 81.24 | — | — | |
| ABMData augmentation=false2022.07 | 56.85 | — | 73.73 | 81.24 | — | — | |
| ABM2024.05 | 56.85 | — | 73.73 | 81.24 | — | — | |
| ABMdata augmentation=none2024.08 | 56.85 | — | 73.73 | 81.24 | — | — | |
| Li et al.2022.07 | 56.59 | — | 69.07 | 75.25 | 78.6 | — | |
| Li et al.Data augmentation=true2022.07 | 56.59 | — | 69.07 | 75.25 | — | — | |
| Li et al.Scale-aug=true2024.07 | 56.59 | — | 69.07 | 75.25 | 78.6 | — | |
| SANScale-aug=false2024.07 | 56.2 | — | 72.6 | 79.2 | — | — | |
| SAN2024.05 | 56.2 | — | 72.6 | 79.2 | — | — | |
| SANdata augmentation=none2024.08 | 56.2 | — | 72.6 | 79.2 | — | — | |
| ABM (baseline)Data augmentation=false, Reproduced=true2022.07 | 56.04 | — | 73.1 | 79.9 | — | — | |
| Qwen2.5-VL-7Bzero-shot=true2025.05 | 55.98 | 65.51 | — | — | — | — | |
| Qwen2.5-VL-7Bzero-shot inference=true2025.05 | 55.98 | — | 68.76 | 77.28 | — | — | |
| BTTRvariant=baseline2022.07 | 55.17 | — | 67.85 | 72.11 | 74.14 | — | |
| TSDNetScale-aug=false2024.07 | 54.7 | — | 68.85 | 74.48 | — | — | |
| MANData augmentation=false, Stroke trajectory coordinates=true2022.07 | 54.05 | — | 68.76 | 72.21 | — | — | |
| BTTR2025.05 | 53.96 | — | — | — | — | — | |
| BTTRzero-shot inference=true2025.05 | 53.96 | — | 66.02 | 70.28 | — | — | |
| BTTRDirection=Bidirectional2021.05 | 53.96 | — | 66.02 | 70.28 | — | 71.4 | |
| BTTRmodel=bidirectionally trained transformer2021.12 | 53.96 | — | 66.02 | 70.28 | — | — | |
| BTTR2022.07 | 53.96 | — | 66.02 | 70.28 | — | — | |
| BTTRData augmentation=false2022.07 | 53.96 | — | 66.02 | 70.28 | — | — | |
| BTTRScale-aug=false2024.07 | 53.96 | — | 66.02 | 70.28 | — | — | |
| BTTR2024.05 | 53.96 | — | 66.02 | 70.28 | — | — | |
| BTTRdata augmentation=none2024.08 | 53.96 | — | 66.02 | 70.28 | — | — | |
| WS WAP2021.05 | 53.65 | — | — | — | — | — | |
| WS WAPsupervision=weakly supervised2021.12 | 53.65 | — | — | — | — | — | |
| WS-WAP2022.07 | 53.65 | — | — | — | — | — | |
| WS-WAPData augmentation=false2022.07 | 53.65 | — | — | — | — | — | |
| WS-WAP2024.05 | 53.65 | — | — | — | — | — | |
| WS-WAPdata augmentation=none2024.08 | 53.65 | — | — | — | — | — | |
| TDv22024.05 | 53.62 | — | — | — | — | — | |
| TDv2data augmentation=none2024.08 | 53.62 | — | — | — | — | — | |
| Dense+MSAdepth of dense block (D)=162018.01 | 52.8 | — | 68.1 | 72 | 72.7 | — | |
| DWAP-MSAattention=multi-scale attention2021.12 | 52.8 | — | 68.1 | 72 | — | — | |
| DWAP-MSAData augmentation=false2022.07 | 52.8 | — | 68.1 | 72 | — | — | |
| Dense WAP-MSA2024.05 | 52.8 | — | 68.1 | 72 | — | — | |
| DenseWAP-MSAdata augmentation=none2024.08 | 52.8 | — | 68.1 | 72 | — | — | |
| DWAP (baseline)Data augmentation=false, Reproduced=true2022.07 | 51.48 | — | 67.01 | 73.3 | — | — | |
| GPT-4ozero-shot=true2025.05 | 50.61 | 60.85 | — | — | — | — |