Situation Recognition on imSitu (dev)
73.62Value AccuracyCAQ w/ RE-VGG
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CAQ w/ RE-VGGEvaluation Setting=Ground-Truth Verb2022.03 | 73.62 | — | — | — | — | — | — | — | — | — | — | 38.71 | |
| Kernel GraphNetEvaluation Setting=Ground-Truth Verb2022.03 | 73.14 | — | — | — | — | — | — | — | — | — | — | 41.68 | |
| CRF w/ DataAugEvaluation Setting=Ground-Truth Verb2022.03 | 70.8 | — | — | — | — | — | — | — | — | — | — | 34.82 | |
| RNN w/ FusionEvaluation Setting=Ground-Truth Verb2022.03 | 70.48 | — | — | — | — | — | — | — | — | — | — | 35.56 | |
| GraphNetEvaluation Setting=Ground-Truth Verb2022.03 | 68.89 | — | — | — | — | — | — | — | — | — | — | 41.07 | |
| CRFEvaluation Setting=Ground-Truth Verb2022.03 | 65.9 | — | — | — | — | — | — | — | — | — | — | 29.5 | |
| Kernel GraphNetEvaluation Setting=Top-5 Predicted Verbs2022.03 | 56.32 | — | — | — | — | — | — | — | — | — | 68.55 | 30.56 | |
| CAQ w/ RE-VGGEvaluation Setting=Top-5 Predicted Verbs2022.03 | 50.3 | — | — | — | — | — | — | — | — | — | 64.99 | 29.17 | |
| RNN w/ FusionEvaluation Setting=Top-5 Predicted Verbs2022.03 | 47.09 | — | — | — | — | — | — | — | — | — | 63.11 | 26.48 | |
| CRF w/ DataAugEvaluation Setting=Top-5 Predicted Verbs2022.03 | 46.72 | — | — | — | — | — | — | — | — | — | 62.21 | 25.66 | |
| GraphNetEvaluation Setting=Top-5 Predicted Verbs2022.03 | 45.23 | — | — | — | — | — | — | — | — | — | 61.8 | 29.98 | |
| CRFEvaluation Setting=Top-5 Predicted Verbs2022.03 | 42.68 | — | — | — | — | — | — | — | — | — | 58.64 | 22.75 | |
| Kernel GraphNetEvaluation Setting=Top-1 Predicted Verb2022.03 | 35.18 | — | — | — | — | — | — | — | — | — | 43.21 | 19.46 | |
| CAQ w/ RE-VGGEvaluation Setting=Top-1 Predicted Verb2022.03 | 30.15 | — | — | — | — | — | — | — | — | — | 37.96 | 18.58 | |
| RNN w/ FusionEvaluation Setting=Top-1 Predicted Verb2022.03 | 27.74 | — | — | — | — | — | — | — | — | — | 36.11 | 16.6 | |
| GraphNetEvaluation Setting=Top-1 Predicted Verb2022.03 | 27.52 | — | — | — | — | — | — | — | — | — | 36.93 | 19.15 | |
| CRF w/ DataAugEvaluation Setting=Top-1 Predicted Verb2022.03 | 26.56 | — | — | — | — | — | — | — | — | — | 34.2 | 15.61 | |
| CRFEvaluation Setting=Top-1 Predicted Verb2022.03 | 24.56 | — | — | — | — | — | — | — | — | — | 32.25 | 14.28 | |
| Baseline: Image RegressionTraining Data=imSitu, Semantic Data Augmentation (+SA)=false, Image Regression Potentials (+reg)=true2016.12 | — | 32.25 | 24.56 | 14.28 | 58.64 | 42.68 | 22.75 | 65.9 | 29.5 | 36.32 | — | — | |
| Baseline: Image RegressionTraining Data=imSitu + web data, Semantic Data Augmentation (+SA)=true, Image Regression Potentials (+reg)=true2016.12 | — | 32.4 | 24.14 | 15.17 | 59.1 | 44.04 | 24.4 | 68.03 | 31.93 | 37.53 | — | — | |
| Inner product composition + regTraining Data=imSitu, Semantic Data Augmentation (+SA)=false, Image Regression Potentials (+reg)=true2016.12 | — | 32.13 | 24.77 | 14.71 | 58.33 | 42.93 | 23.14 | 66.79 | 30.2 | 36.62 | — | — | |
| Noun Potential + regTraining Data=imSitu, Semantic Data Augmentation (+SA)=false, Image Regression Potentials (+reg)=true2016.12 | — | 27.64 | 21.21 | 12.21 | 53.95 | 39.95 | 21.45 | 68.87 | 32.31 | 34.7 | — | — | |
| Tensor compositionTraining Data=imSitu, Semantic Data Augmentation (+SA)=false, Image Regression Potentials (+reg)=false2016.12 | — | 31.73 | 24.04 | 13.73 | 58.06 | 42.64 | 22.7 | 68.73 | 32.14 | 36.72 | — | — | |
| Tensor composition + regTraining Data=imSitu, Semantic Data Augmentation (+SA)=false, Image Regression Potentials (+reg)=true2016.12 | — | 32.91 | 25.39 | 14.87 | 59.92 | 44.5 | 24.04 | 69.39 | 33.17 | 38.02 | — | — | |
| Tensor composition + regTraining Data=imSitu + web data, Semantic Data Augmentation (+SA)=true, Image Regression Potentials (+reg)=true2016.12 | — | 34.04 | 26.47 | 15.73 | 61.75 | 46.48 | 25.77 | 70.89 | 35.08 | 39.53 | — | — | |
| Tensor composition + reg + self trainTraining Data=imSitu + web data, Semantic Data Augmentation (+SA)=true, Image Regression Potentials (+reg)=true, Self-training=true2016.12 | — | 34.2 | 26.56 | 15.61 | 62.21 | 46.72 | 25.66 | 70.8 | 34.82 | 39.57 | — | — |