# Multi-label Image Classification on NUS-WIDE 81 concept labels (test)

Source: [Multi-label Image Classification on NUS-WIDE 81 concept labels (test)](<https://www.sota2.com/research/sota/multi-label-image-classification-on-nus-wide-81-concept-labels-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:42:49.917Z

Evaluation of Multi-label Image Classification performance on the test split of the NUS-WIDE dataset, utilizing the 81 concept labels. Metrics reported include mAP, and F1/Precision/Recall calculated at both class (C) and overall (O) levels.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multi-label Image Classification |
| Dataset (including any stated split) | NUS-WIDE 81 concept labels (test) |
| Metric | F1 (Class) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 33 of 33 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [F1 (Class)](<https://www.sota2.com/research/sota/multi-label-image-classification-on-nus-wide-81-concept-labels-test.md?metric=F1%20(Class)>): Higher is better; unit: PERCENT.

- [mAP](<https://www.sota2.com/research/sota/multi-label-image-classification-on-nus-wide-81-concept-labels-test.md?metric=mAP>): Higher is better; unit: PERCENT.

- [Precision (Class)](<https://www.sota2.com/research/sota/multi-label-image-classification-on-nus-wide-81-concept-labels-test.md?metric=Precision%20(Class)>): Higher is better; unit: PERCENT.

- [Recall (Class)](<https://www.sota2.com/research/sota/multi-label-image-classification-on-nus-wide-81-concept-labels-test.md?metric=Recall%20(Class)>): Higher is better; unit: PERCENT.

- [F1 (Overall)](<https://www.sota2.com/research/sota/multi-label-image-classification-on-nus-wide-81-concept-labels-test.md?metric=F1%20(Overall)>): Higher is better; unit: PERCENT.

- [Precision (Overall)](<https://www.sota2.com/research/sota/multi-label-image-classification-on-nus-wide-81-concept-labels-test.md?metric=Precision%20(Overall)>): Higher is better; unit: PERCENT.

- [Recall (Overall)](<https://www.sota2.com/research/sota/multi-label-image-classification-on-nus-wide-81-concept-labels-test.md?metric=Recall%20(Overall)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | F1 (Class) | Result date | Report paper |
| --- | --- | --- | --- |
| Ours-S-Cls (w/) | 58.7 | Not recorded | 68fa65641e209131cea09eb6 |
| ResNet-SRN | 58.5 | Not recorded | 68fa633a1e209131ce9fda6c |
| ResNet-SRN-att | 56.9 | Not recorded | 68fa633a1e209131ce9fda6c |
| ResNet-101 | 55.7 | Not recorded | 68fa633a1e209131ce9fda6c |
| ResNet-107 | 55.6 | Not recorded | 68fa633a1e209131ce9fda6c |
| Attention transfer | 55.2 | Not recorded | 68fa65641e209131cea09eb6 |
| ResNet-101-semantic | 54.9 | Not recorded | 68fa633a1e209131ce9fda6c |
| FitNets | 54.9 | Not recorded | 68fa65641e209131cea09eb6 |
| Distillation | 54.3 | Not recorded | 68fa65641e209131cea09eb6 |
| Ours-S-Cls (w/) | 53.8 | Not recorded | 68fa65641e209131cea09eb6 |
| CNN-LSEP | 52.9 | Not recorded | 68fa65641e209131cea09eb6 |
| CNN-SREL-RNN | 52.8 | Not recorded | 68fa65641e209131cea09eb6 |
| Ours-S-Cls (w/o) | 52 | Not recorded | 68fa65641e209131cea09eb6 |
| Attention transfer | 51.7 | Not recorded | 68fa65641e209131cea09eb6 |
| FitNets | 51.4 | Not recorded | 68fa65641e209131cea09eb6 |
| Distillation | 50.3 | Not recorded | 68fa65641e209131cea09eb6 |
| ResNet-SRN | 48.9 | Not recorded | 68fa633a1e209131ce9fda6c |
| ResNet-SRN-att | 47.7 | Not recorded | 68fa633a1e209131ce9fda6c |
| Ours-S-Cls (w/o) | 47.5 | Not recorded | 68fa65641e209131cea09eb6 |
| ResNet-101 | 47 | Not recorded | 68fa633a1e209131ce9fda6c |
| ResNet-101-semantic | 47 | Not recorded | 68fa633a1e209131ce9fda6c |
| ResNet-107 | 46.9 | Not recorded | 68fa633a1e209131ce9fda6c |
| RLSD | 46.9 | Not recorded | 68fa65641e209131cea09eb6 |
| MCG-CNN-LSTM | 46.1 | Not recorded | 68fa65641e209131cea09eb6 |
| Tag-Neighbors | 45.2 | Not recorded | 68fa65641e209131cea09eb6 |
| CNN-RNN | 34.7 | Not recorded | 68fa633a1e209131ce9fda6c |
| CNN-RNN | 34.7 | Not recorded | 68fa65641e209131cea09eb6 |
| WARP | 33.5 | Not recorded | 68fa633a1e209131ce9fda6c |
| KNN | 24.3 | Not recorded | 68fa633a1e209131ce9fda6c |

### Ours-S-Cls (w/)

F1 (Class): 58.7. Result ID: 698ca8c48b517eb4331bdefb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Implementation](<https://yochengliu.github.io/MLIC-KD-WSD/>)

Recorded evaluation configuration: {"Prediction Scope":"All","Knowledge Distillation":true}. This record does not assert independent reproduction.

### ResNet-SRN

F1 (Class): 58.5. Result ID: 698bed36ecace47ef55a4043.

[Reporting paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

[Implementation](<https://github.com/zhufengx/SRN_multilabel.>)

Recorded evaluation configuration: {"label prediction strategy":"All"}. This record does not assert independent reproduction.

### ResNet-SRN-att

F1 (Class): 56.9. Result ID: 698bed36ecace47ef55a4042.

[Reporting paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

[Implementation](<https://github.com/zhufengx/SRN_multilabel.>)

Recorded evaluation configuration: {"label prediction strategy":"All"}. This record does not assert independent reproduction.

### ResNet-101

F1 (Class): 55.7. Result ID: 698bed36ecace47ef55a403f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62321e209131ce9f8328.md>)

Recorded evaluation configuration: {"label prediction strategy":"All"}. This record does not assert independent reproduction.

### ResNet-107

F1 (Class): 55.6. Result ID: 698bed36ecace47ef55a4040.

[Reporting paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

Recorded evaluation configuration: {"label prediction strategy":"All"}. This record does not assert independent reproduction.

### Attention transfer

F1 (Class): 55.2. Result ID: 698ca8c48b517eb4331bdef9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa631f1e209131ce9fd01c.md>)

[Implementation](<https://github.com/szagoruyko/attention-transfer>)

Recorded evaluation configuration: {"Prediction Scope":"All"}. This record does not assert independent reproduction.

### ResNet-101-semantic

F1 (Class): 54.9. Result ID: 698bed36ecace47ef55a4041.

[Reporting paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

Recorded evaluation configuration: {"label prediction strategy":"All"}. This record does not assert independent reproduction.

### FitNets

F1 (Class): 54.9. Result ID: 698ca8c48b517eb4331bdef7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa61ca1e209131ce9f5ebe.md>)

Recorded evaluation configuration: {"Prediction Scope":"All"}. This record does not assert independent reproduction.

### Distillation

F1 (Class): 54.3. Result ID: 698ca8c48b517eb4331bdef5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa61b81e209131ce9f5b87.md>)

Recorded evaluation configuration: {"Prediction Scope":"All"}. This record does not assert independent reproduction.

### Ours-S-Cls (w/)

F1 (Class): 53.8. Result ID: 698ca8c48b517eb4331bdefc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Implementation](<https://yochengliu.github.io/MLIC-KD-WSD/>)

Recorded evaluation configuration: {"Prediction Scope":"Top-3","Knowledge Distillation":true}. This record does not assert independent reproduction.

### CNN-LSEP

F1 (Class): 52.9. Result ID: 698ca8c48b517eb4331bdeec.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa636a1e209131ce9fe97d.md>)

Recorded evaluation configuration: {"Prediction Scope":"All"}. This record does not assert independent reproduction.

### CNN-SREL-RNN

F1 (Class): 52.8. Result ID: 698ca8c48b517eb4331bdeed.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62ed1e209131ce9fbe74.md>)

Recorded evaluation configuration: {"Prediction Scope":"All"}. This record does not assert independent reproduction.

### Ours-S-Cls (w/o)

F1 (Class): 52. Result ID: 698ca8c48b517eb4331bdef3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Implementation](<https://yochengliu.github.io/MLIC-KD-WSD/>)

Recorded evaluation configuration: {"Prediction Scope":"All","Knowledge Distillation":false}. This record does not assert independent reproduction.

### Attention transfer

F1 (Class): 51.7. Result ID: 698ca8c48b517eb4331bdefa.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa631f1e209131ce9fd01c.md>)

[Implementation](<https://github.com/szagoruyko/attention-transfer>)

Recorded evaluation configuration: {"Prediction Scope":"Top-3"}. This record does not assert independent reproduction.

### FitNets

F1 (Class): 51.4. Result ID: 698ca8c48b517eb4331bdef8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa61ca1e209131ce9f5ebe.md>)

Recorded evaluation configuration: {"Prediction Scope":"Top-3"}. This record does not assert independent reproduction.

### Distillation

F1 (Class): 50.3. Result ID: 698ca8c48b517eb4331bdef6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa61b81e209131ce9f5b87.md>)

Recorded evaluation configuration: {"Prediction Scope":"Top-3"}. This record does not assert independent reproduction.

### ResNet-SRN

F1 (Class): 48.9. Result ID: 698bed36ecace47ef55a404b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

[Implementation](<https://github.com/zhufengx/SRN_multilabel.>)

Recorded evaluation configuration: {"label prediction strategy":"top-3"}. This record does not assert independent reproduction.

### ResNet-SRN-att

F1 (Class): 47.7. Result ID: 698bed36ecace47ef55a404a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

[Implementation](<https://github.com/zhufengx/SRN_multilabel.>)

Recorded evaluation configuration: {"label prediction strategy":"top-3"}. This record does not assert independent reproduction.

### Ours-S-Cls (w/o)

F1 (Class): 47.5. Result ID: 698ca8c48b517eb4331bdef4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Implementation](<https://yochengliu.github.io/MLIC-KD-WSD/>)

Recorded evaluation configuration: {"Prediction Scope":"Top-3","Knowledge Distillation":false}. This record does not assert independent reproduction.

### ResNet-101

F1 (Class): 47. Result ID: 698bed36ecace47ef55a4047.

[Reporting paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62321e209131ce9f8328.md>)

Recorded evaluation configuration: {"label prediction strategy":"top-3"}. This record does not assert independent reproduction.

### ResNet-101-semantic

F1 (Class): 47. Result ID: 698bed36ecace47ef55a4049.

[Reporting paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

Recorded evaluation configuration: {"label prediction strategy":"top-3"}. This record does not assert independent reproduction.

### ResNet-107

F1 (Class): 46.9. Result ID: 698bed36ecace47ef55a4048.

[Reporting paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

Recorded evaluation configuration: {"label prediction strategy":"top-3"}. This record does not assert independent reproduction.

### RLSD

F1 (Class): 46.9. Result ID: 698ca8c48b517eb4331bdef1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa632f1e209131ce9fd277.md>)

Recorded evaluation configuration: {"Prediction Scope":"Top-3"}. This record does not assert independent reproduction.

### MCG-CNN-LSTM

F1 (Class): 46.1. Result ID: 698ca8c48b517eb4331bdeef.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa632f1e209131ce9fd277.md>)

Recorded evaluation configuration: {"Prediction Scope":"Top-3"}. This record does not assert independent reproduction.

### Tag-Neighbors

F1 (Class): 45.2. Result ID: 698ca8c48b517eb4331bdeeb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62181e209131ce9f7935.md>)

Recorded evaluation configuration: {"Prediction Scope":"Top-3"}. This record does not assert independent reproduction.

### CNN-RNN

F1 (Class): 34.7. Result ID: 698bed36ecace47ef55a4046.

[Reporting paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa626a1e209131ce9f9411.md>)

Recorded evaluation configuration: {"label prediction strategy":"top-3"}. This record does not assert independent reproduction.

### CNN-RNN

F1 (Class): 34.7. Result ID: 698ca8c48b517eb4331bdee9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09eb6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa626a1e209131ce9f9411.md>)

Recorded evaluation configuration: {"Prediction Scope":"Top-3"}. This record does not assert independent reproduction.

### WARP

F1 (Class): 33.5. Result ID: 698bed36ecace47ef55a4045.

[Reporting paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa61501e209131ce9f3b6f.md>)

Recorded evaluation configuration: {"label prediction strategy":"top-3"}. This record does not assert independent reproduction.

### KNN

F1 (Class): 24.3. Result ID: 698bed36ecace47ef55a4044.

[Reporting paper](<https://www.sota2.com/research/paper/68fa633a1e209131ce9fda6c.md>)

Recorded evaluation configuration: {"label prediction strategy":"top-3"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
