Facial Action Unit Recognition on BP4D (F1 Scores)
59.7AU 1 F1WSRTL
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| WSRTLModeling Approach=Spatio-temporal2024.04 | 59.7 | 51.7 | 61.6 | 80.3 | 80.9 | 85.2 | 89.7 | 67.8 | 52.2 | 63.4 | 51.4 | 46.9 | 65.9 | |
| MDHRModeling Approach=Spatio-temporal, Backbone=ResNet-502024.04 | 58.3 | 50.9 | 58.9 | 78.4 | 80.3 | 84.9 | 88.2 | 69.5 | 56 | 65.5 | 49.5 | 59.3 | 66.6 | |
| SEV-Net2022.05 | 58.2 | 50.4 | 58.3 | 81.9 | 73.9 | 87.8 | 87.5 | 61.6 | 52.6 | 62.2 | 44.6 | 47.6 | 63.9 | |
| SMA-NetModeling Approach=Static image-based2024.04 | 56.5 | 45.1 | 57 | 79.5 | 79.5 | 84.5 | 86.4 | 66.1 | 55.8 | 64.2 | 48.7 | 56.8 | 64.9 | |
| HSTR-NetModeling Approach=Spatio-temporal2024.04 | 55.5 | 49.5 | 61.9 | 76.6 | 80.2 | 84.2 | 87.4 | 62.6 | 54.8 | 64.1 | 47.1 | 52.1 | 64.7 | |
| FAN-TransModeling Approach=Static AU relationship modeling2024.04 | 55.4 | 46 | 59.8 | 78.7 | 77.7 | 82.7 | 88.6 | 64.7 | 51.4 | 65.7 | 50.9 | 56 | 64.8 | |
| KSModeling Approach=Spatio-temporal2024.04 | 55.3 | 48.6 | 57.1 | 77.5 | 81.8 | 83.3 | 86.4 | 62.8 | 52.3 | 61.3 | 51.6 | 58.3 | 64.7 | |
| MDHRModeling Approach=Spatio-temporal, Backbone=Swin-B2024.04 | 54.6 | 49.7 | 61 | 79.9 | 79.4 | 85.4 | 88.5 | 67.8 | 56.8 | 63.2 | 50.9 | 55.4 | 66.1 | |
| UGN-B2022.05 | 54.2 | 46.4 | 56.8 | 76.2 | 76.7 | 82.4 | 86.1 | 64.7 | 51.2 | 63.1 | 48.5 | 53.6 | 63.3 | |
| Ours (ResNet-50)Backbone=ResNet-502022.05 | 53.7 | 46.9 | 59 | 78.5 | 80 | 84.4 | 87.8 | 67.3 | 52.5 | 63.2 | 50.6 | 52.4 | 64.7 | |
| HMP-PS2022.05 | 53.1 | 46.1 | 56 | 76.5 | 76.9 | 82.1 | 86.4 | 64.8 | 51.5 | 63 | 49.9 | 54.5 | 63.4 | |
| Ours (Swin Transformer-Base)Backbone=Swin Transformer-Base2022.05 | 52.7 | 44.3 | 60.9 | 79.9 | 80.1 | 85.3 | 89.2 | 69.4 | 55.4 | 64.4 | 49.8 | 55.1 | 65.5 | |
| ME-GraphAUModeling Approach=Static AU relationship modeling2024.04 | 52.7 | 44.3 | 60.9 | 79.9 | 80.1 | 85.3 | 89.2 | 69.4 | 55.4 | 64.4 | 49.8 | 55.1 | 65.5 | |
| FAUDT2022.05 | 51.7 | 49.3 | 61 | 77.8 | 79.5 | 82.9 | 86.3 | 67.6 | 51.9 | 63 | 43.7 | 56.3 | 64.2 | |
| FAUDTModeling Approach=Static AU relationship modeling2024.04 | 51.7 | 49.3 | 61 | 77.8 | 79.5 | 82.9 | 86.3 | 67.6 | 51.9 | 63 | 43.7 | 56.3 | 64.2 | |
| STRALModeling Approach=Spatio-temporal2024.04 | 48.2 | 47.7 | 58.1 | 75.8 | 78.1 | 81.6 | 87.6 | 60.5 | 50.2 | 64 | 51.2 | 55.2 | 63.2 | |
| JAA-Net2022.05 | 47.2 | 44 | 54.9 | 77.5 | 74.6 | 84 | 86.9 | 61.9 | 43.6 | 60.3 | 42.7 | 41.9 | 60 | |
| JAA-NetModeling Approach=Static image-based2024.04 | 47.2 | 44 | 54.9 | 77.5 | 74.6 | 84 | 86.9 | 61.9 | 43.6 | 60.3 | 42.7 | 41.9 | 60 | |
| SRERL2022.05 | 46.9 | 45.3 | 55.6 | 77.1 | 78.4 | 83.5 | 87.6 | 63.9 | 52.2 | 63.9 | 47.1 | 53.3 | 62.9 | |
| SRERLModeling Approach=Static AU relationship modeling2024.04 | 46.9 | 45.3 | 55.6 | 77.1 | 78.4 | 83.5 | 87.6 | 63.9 | 52.2 | 63.9 | 47.1 | 53.3 | 62.9 | |
| ARL2022.05 | 45.8 | 39.8 | 55.1 | 75.7 | 77.2 | 82.3 | 86.6 | 58.8 | 47.6 | 62.1 | 47.4 | 55.4 | 61.1 | |
| ARLModeling Approach=Static image-based2024.04 | 45.8 | 39.8 | 55.1 | 75.7 | 77.2 | 82.3 | 86.6 | 58.8 | 47.6 | 62.1 | 47.4 | 55.4 | 61.1 | |
| LP-Net2022.05 | 43.4 | 38 | 54.2 | 77.1 | 76.7 | 83.8 | 87.2 | 63.3 | 45.3 | 60.5 | 48.1 | 54.2 | 61 | |
| EAC-Net2022.05 | 39 | 35.2 | 48.6 | 76.1 | 72.9 | 81.9 | 86.2 | 58.8 | 37.5 | 59.1 | 35.9 | 35.8 | 55.9 | |
| EAC-NetModeling Approach=Static image-based2024.04 | 39 | 35.2 | 48.6 | 76.1 | 72.9 | 81.9 | 86.2 | 58.8 | 37.5 | 59.1 | 35.9 | 35.8 | 55.9 | |
| DRML2022.05 | 36.4 | 41.8 | 43 | 55 | 67 | 66.3 | 65.8 | 54.1 | 33.2 | 48 | 31.7 | 30 | 48.3 |