Handwritten Mathematical Expression Recognition on CROHME 2016 (test)
77.94Expression Rate (Exp)Uni-MuMER
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Uni-MuMERexternal data=true2025.05 | 77.94 | 81.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Uni-MuMERzero-shot inference=true, external data used=true2025.05 | 77.94 | — | 87.45 | 92.07 | — | — | — | — | — | — | — | — | — | — | — | |
| Uni-MuMER2025.05 | 70.79 | 75.24 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Uni-MuMERzero-shot inference=true2025.05 | 70.79 | — | 83.44 | 89.54 | — | — | — | — | — | — | — | — | — | — | — | |
| HiE-VLexternal data=true2025.05 | 70.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| HiE-VLMzero-shot inference=true, external data used=true2025.05 | 70.7 | — | 82.1 | 86.4 | — | — | — | — | — | — | — | — | — | — | — | |
| UniMERNetdata augmentation=true, external data=true2025.05 | 68.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Vanilla (baseline)reproduced=true2025.05 | 64.26 | 67.83 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Vanilla (baseline)zero-shot inference=true2025.05 | 64.26 | — | 77.77 | 84.22 | — | — | — | — | — | — | — | — | — | — | — | |
| CAN-ABMData augmentation=true2022.07 | 63.12 | — | — | — | — | — | — | — | — | — | — | 75.94 | 82.74 | — | — | |
| SSANdata augmentation=true, reproduced=true2025.05 | 62.51 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SSANzero-shot inference=true, data augmentation=true2025.05 | 62.51 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CAN-DWAPData augmentation=true2022.07 | 62.51 | — | — | — | — | — | — | — | — | — | — | 74.63 | 82.48 | — | — | |
| SANData Augmentation=true2022.03 | 61.5 | — | — | — | — | — | 73.3 | 81.4 | — | — | — | — | — | — | — | |
| PosFormerdata augmentation=true, reproduced=true2025.05 | 61.03 | 65.39 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PosFormerzero-shot inference=true, data augmentation=true2025.05 | 61.03 | — | 77.86 | 84.74 | — | — | — | — | — | — | — | — | — | — | — | |
| PosFormerScale-aug=true2024.07 | 61.03 | — | 77.86 | 84.74 | 89.28 | — | — | — | — | — | — | — | — | — | — | |
| PosFormer2025.05 | 60.94 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PosFormerzero-shot inference=true2025.05 | 60.94 | — | 76.72 | 83.87 | — | — | — | — | — | — | — | — | — | — | — | |
| PosFormerScale-aug=false2024.07 | 60.94 | — | 76.72 | 83.87 | 88.06 | — | — | — | — | — | — | — | — | — | — | |
| ABM (baseline)Data augmentation=true, Reproduced=true2022.07 | 60.86 | — | — | — | — | — | — | — | — | — | — | 73.93 | 81.17 | — | — | |
| VLPGzero-shot inference=true, external data used=true2025.05 | 60.51 | — | 75.5 | 79.86 | — | — | — | — | — | — | — | — | — | — | — | |
| TAMERzero-shot inference=true2025.05 | 60.26 | — | 76.91 | 84.05 | — | — | — | — | — | — | — | — | — | — | — | |
| TAMERdata augmentation=none2024.08 | 60.26 | — | — | — | — | — | — | — | — | — | — | 76.91 | 84.05 | — | — | |
| NAMERdata augmentation=none2024.08 | 60.24 | — | — | — | — | — | — | — | — | — | — | 73.5 | 80.21 | — | — | |
| VLPGexternal data=true2025.05 | 60.21 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SSAN2025.05 | 60.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SSANzero-shot inference=true2025.05 | 60.02 | — | 76.22 | 83.28 | — | — | — | — | — | — | — | — | — | — | — | |
| COMERreproduced=true2025.05 | 59.81 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| COMERzero-shot inference=true, reproduced=true2025.05 | 59.81 | — | 74.37 | 80.3 | — | — | — | — | — | — | — | — | — | — | — | |
| CoMER2022.07 | 59.81 | — | — | — | — | — | — | — | 74.37 | 80.3 | 82.56 | — | — | — | — | |
| COMERScale-aug=true2024.07 | 59.81 | — | 74.37 | 80.3 | 82.56 | — | — | — | — | — | — | — | — | — | — | |
| TAMER2025.05 | 59.54 | 62.94 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GCNsupplementary_information=true2024.05 | 58.94 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GCNdata augmentation=none2024.08 | 58.94 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ICAL2025.05 | 58.79 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ICAL2024.05 | 58.79 | — | — | — | — | — | — | — | — | — | — | — | — | 76.06 | 83.38 | |
| ICALdata augmentation=none2024.08 | 58.79 | — | — | — | — | — | — | — | — | — | — | 76.06 | 83.38 | — | — | |
| BPD-CoverageScale-aug=true2024.07 | 58.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ding et al.2022.07 | 57.72 | — | — | — | — | — | — | — | 70.01 | 76.37 | 78.9 | — | — | — | — | |
| Ding et al.Data augmentation=true2022.07 | 57.72 | — | — | — | — | — | — | — | — | — | — | 70.01 | 76.37 | — | — | |
| Ding et al.Data Augmentation=true2022.03 | 57.7 | — | — | — | — | — | 70 | 76.4 | — | — | — | — | — | — | — | |
| COMER2025.05 | 56.98 | 63.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| COMERzero-shot inference=true2025.05 | 56.98 | — | 74.44 | 81.87 | — | — | — | — | — | — | — | — | — | — | — | |
| CoMERreproduced=true2024.05 | 56.98 | — | — | — | — | — | — | — | — | — | — | — | — | 74.44 | 81.87 | |
| CoMERdata augmentation=none, reproduced=true2024.08 | 56.98 | — | — | — | — | — | — | — | — | — | — | 74.44 | 81.87 | — | — | |
| BTTRvariant=baseline2022.07 | 56.58 | — | — | — | — | — | — | — | 68.88 | 74.19 | 76.9 | — | — | — | — | |
| CAN-ABM2025.05 | 56.15 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CAN-ABMzero-shot inference=true2025.05 | 56.15 | — | 72.71 | 80.3 | — | — | — | — | — | — | — | — | — | — | — | |
| CAN-ABMData augmentation=false2022.07 | 56.15 | — | — | — | — | — | — | — | — | — | — | 72.71 | 80.3 | — | — | |
| CANScale-aug=false2024.07 | 56.15 | — | 72.71 | 80.3 | — | — | — | — | — | — | — | — | — | — | — | |
| CAN-ABM2024.05 | 56.15 | — | — | — | — | — | — | — | — | — | — | — | — | 72.71 | 80.3 | |
| CAN-ABMdata augmentation=none2024.08 | 56.15 | — | — | — | — | — | — | — | — | — | — | 72.71 | 80.3 | — | — | |
| CAN-DWAPData augmentation=false2022.07 | 56.06 | — | — | — | — | — | — | — | — | — | — | 71.49 | 79.51 | — | — | |
| CAN-DWAP2024.05 | 56.06 | — | — | — | — | — | — | — | — | — | — | — | — | 71.49 | 79.51 | |
| CAN-DWAPdata augmentation=none2024.08 | 56.06 | — | — | — | — | — | — | — | — | — | — | 71.49 | 79.51 | — | — | |
| DWAP (baseline)Data augmentation=true, Reproduced=true2022.07 | 55.97 | — | — | — | — | — | — | — | — | — | — | 71.4 | 79.86 | — | — | |
| TDv22024.05 | 55.18 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TDv2data augmentation=none2024.08 | 55.18 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Li et al.Data Augmentation=true2022.03 | 54.6 | — | — | — | — | — | 69.3 | 73.8 | — | — | — | — | — | — | — | |
| Li et al.2022.07 | 54.58 | — | — | — | — | — | — | — | 69.31 | 73.76 | 76.02 | — | — | — | — | |
| Li et al.Data augmentation=true2022.07 | 54.58 | — | — | — | — | — | — | — | — | — | — | 69.31 | 73.76 | — | — | |
| Li et al.Scale-aug=true2024.07 | 54.58 | — | 69.31 | 73.76 | 76.02 | — | — | — | — | — | — | — | — | — | — | |
| Qwen2.5-VL-72Bzero-shot=true2025.05 | 54.32 | 59.37 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen2.5-VL-72Bzero-shot inference=true2025.05 | 54.32 | — | 69.53 | 77.51 | — | — | — | — | — | — | — | — | — | — | — | |
| SANData Augmentation=false2022.03 | 53.6 | — | — | — | — | — | 69.6 | 76.8 | — | — | — | — | — | — | — | |
| SANScale-aug=false2024.07 | 53.6 | — | 69.6 | 76.8 | — | — | — | — | — | — | — | — | — | — | — | |
| SAN2024.05 | 53.6 | — | — | — | — | — | — | — | — | — | — | — | — | 69.6 | 76.8 | |
| SANdata augmentation=none2024.08 | 53.6 | — | — | — | — | — | — | — | — | — | — | 69.6 | 76.8 | — | — | |
| ABM (baseline)Data augmentation=false, Reproduced=true2022.07 | 53.36 | — | — | — | — | — | — | — | — | — | — | 70.01 | 78.12 | — | — | |
| ABM2025.05 | 52.92 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ABMzero-shot inference=true2025.05 | 52.92 | — | 69.66 | 78.73 | — | — | — | — | — | — | — | — | — | — | — | |
| ABM2021.12 | 52.92 | — | 69.66 | 78.73 | — | — | — | — | — | — | — | — | — | — | — | |
| ABMData augmentation=false2022.07 | 52.92 | — | — | — | — | — | — | — | — | — | — | 69.66 | 78.73 | — | — | |
| ABM2024.05 | 52.92 | — | — | — | — | — | — | — | — | — | — | — | — | 69.66 | 78.73 | |
| ABMdata augmentation=none2024.08 | 52.92 | — | — | — | — | — | — | — | — | — | — | 69.66 | 78.73 | — | — | |
| Gemini2.5-flashzero-shot=true2025.05 | 52.74 | 61.34 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Gemini 1.5-flashzero-shot inference=true2025.05 | 52.74 | — | 67.28 | 76.24 | — | — | — | — | — | — | — | — | — | — | — | |
| TSDNetScale-aug=false2024.07 | 52.48 | — | 68.26 | 73.41 | — | — | — | — | — | — | — | — | — | — | — | |
| BTTR2025.05 | 52.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BTTRzero-shot inference=true2025.05 | 52.31 | — | 63.9 | 68.61 | — | — | — | — | — | — | — | — | — | — | — | |
| BTTRDirection=Bidirectional2021.05 | 52.31 | — | 63.9 | 68.61 | — | 69.4 | — | — | — | — | — | — | — | — | — | |
| BTTRmodel=bidirectionally trained transformer2021.12 | 52.31 | — | 63.9 | 68.61 | — | — | — | — | — | — | — | — | — | — | — | |
| BTTR2022.07 | 52.31 | — | — | — | — | — | — | — | 63.9 | 68.61 | — | — | — | — | — | |
| BTTRData augmentation=false2022.07 | 52.31 | — | — | — | — | — | — | — | — | — | — | 63.9 | 68.61 | — | — | |
| BTTRScale-aug=false2024.07 | 52.31 | — | 63.9 | 68.61 | — | — | — | — | — | — | — | — | — | — | — | |
| BTTR2024.05 | 52.31 | — | — | — | — | — | — | — | — | — | — | — | — | 63.9 | 68.61 | |
| BTTRdata augmentation=none2024.08 | 52.31 | — | — | — | — | — | — | — | — | — | — | 63.9 | 68.61 | — | — | |
| BTTRData Augmentation=false2022.03 | 52.3 | — | — | — | — | — | 63.9 | 68.6 | — | — | — | — | — | — | — | |
| RBRData Augmentation=false2022.03 | 52.1 | — | — | — | — | — | 63.2 | 69.4 | — | — | — | — | — | — | — | |
| WS-WAPData Augmentation=false2022.03 | 52 | — | — | — | — | — | 64.3 | 70.1 | — | — | — | — | — | — | — | |
| WS WAP2021.05 | 51.96 | — | 64.34 | 70.1 | — | — | — | — | — | — | — | — | — | — | — | |
| WS WAPsupervision=weakly supervised2021.12 | 51.96 | — | 64.34 | 70.1 | — | — | — | — | — | — | — | — | — | — | — | |
| WS-WAP2022.07 | 51.96 | — | — | — | — | — | — | — | 64.34 | 70.1 | 72.97 | — | — | — | — | |
| WS-WAPData augmentation=false2022.07 | 51.96 | — | — | — | — | — | — | — | — | — | — | 64.34 | 70.1 | — | — | |
| WS-WAP2024.05 | 51.96 | — | — | — | — | — | — | — | — | — | — | — | — | 64.34 | 70.1 | |
| WS-WAPdata augmentation=none2024.08 | 51.96 | — | — | — | — | — | — | — | — | — | — | 64.34 | 70.1 | — | — | |
| Qwen2.5-VL-7Bzero-shot=true2025.05 | 50.92 | 56.32 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen2.5-VL-7Bzero-shot inference=true2025.05 | 50.92 | — | 67.13 | 76.37 | — | — | — | — | — | — | — | — | — | — | — | |
| DWAP (baseline)Data augmentation=false, Reproduced=true2022.07 | 50.65 | — | — | — | — | — | — | — | — | — | — | 63.3 | 70.88 | — | — |