# Referring Object Classification on LVIS (val) (Point/Box/Free-form Metrics)

Source: [Referring Object Classification on LVIS (val) (Point/Box/Free-form Metrics)](<https://www.sota2.com/research/sota/referring-object-classification-on-lvis-val-point-box-free-form-metrics>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:00:25.663Z

Evaluation of Referring Object Classification performance on the validation split of the LVIS dataset, reporting Point, Box, and Free-form metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Referring Object Classification |
| Dataset (including any stated split) | LVIS (val) |
| Metric | ROC Box Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [ROC Box Score](<https://www.sota2.com/research/sota/referring-object-classification-on-lvis-val-point-box-free-form-metrics.md?metric=ROC%20Box%20Score>): Higher is better; unit: PERCENT.

- [ROC Point Score](<https://www.sota2.com/research/sota/referring-object-classification-on-lvis-val-point-box-free-form-metrics.md?metric=ROC%20Point%20Score>): Higher is better; unit: PERCENT.

- [ROC Free-form Score](<https://www.sota2.com/research/sota/referring-object-classification-on-lvis-val-point-box-free-form-metrics.md?metric=ROC%20Free-form%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | ROC Box Score | Result date | Report paper |
| --- | --- | --- | --- |
| Ferret-v2 | 87.74 | Not recorded | 68fa72df1e209131cea5914a |
| Ferret-v2 | 86.59 | Not recorded | 68fa72df1e209131cea5914a |
| SPHINX-2k | 82.97 | Not recorded | 68fa72df1e209131cea5914a |
| Ferret | 80.46 | Not recorded | 68fa72df1e209131cea5914a |
| CogVLM | 79.62 | Not recorded | 68fa72df1e209131cea5914a |
| Ferret | 79.42 | Not recorded | 68fa72df1e209131cea5914a |
| Shikra | 67.71 | Not recorded | 68fa72df1e209131cea5914a |
| GPT4-ROI | 61.76 | Not recorded | 68fa72df1e209131cea5914a |
| Kosmos-2 | 60.25 | Not recorded | 68fa72df1e209131cea5914a |
| Random Guess | 50 | Not recorded | 68fa72df1e209131cea5914a |

### Ferret-v2

ROC Box Score: 87.74. Result ID: 699285783a6c3148490f8627.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

Recorded evaluation configuration: {"Size":"13B"}. This record does not assert independent reproduction.

### Ferret-v2

ROC Box Score: 86.59. Result ID: 699285783a6c3148490f8625.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

Recorded evaluation configuration: {"Size":"7B"}. This record does not assert independent reproduction.

### SPHINX-2k

ROC Box Score: 82.97. Result ID: 699285783a6c3148490f8623.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa712e1e209131cea4fc54.md>)

[Implementation](<https://github.com/Alpha-VLLM/LLaMA2-Accessory>)

Recorded evaluation configuration: {"Resolution":"2k"}. This record does not assert independent reproduction.

### Ferret

ROC Box Score: 80.46. Result ID: 699285783a6c3148490f8626.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70d81e209131cea4da64.md>)

Recorded evaluation configuration: {"Size":"13B"}. This record does not assert independent reproduction.

### CogVLM

ROC Box Score: 79.62. Result ID: 699285783a6c3148490f8622.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa721c1e209131cea548b9.md>)

[Implementation](<https://github.com/THUDM/CogVLM>)

Recorded evaluation configuration: {"Size":"17B"}. This record does not assert independent reproduction.

### Ferret

ROC Box Score: 79.42. Result ID: 699285783a6c3148490f8624.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70d81e209131cea4da64.md>)

Recorded evaluation configuration: {"Size":"7B"}. This record does not assert independent reproduction.

### Shikra

ROC Box Score: 67.71. Result ID: 699285783a6c3148490f8620.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fe61e209131cea47fbc.md>)

[Implementation](<https://github.com/shikras/shikra>)

Recorded evaluation configuration: {"Size":"7B"}. This record does not assert independent reproduction.

### GPT4-ROI

ROC Box Score: 61.76. Result ID: 699285783a6c3148490f8621.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa794e1e209131cea7d037.md>)

[Implementation](<https://github.com/jshilong/GPT4RoI>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Kosmos-2

ROC Box Score: 60.25. Result ID: 699285783a6c3148490f861f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa700a1e209131cea48c7f.md>)

[Implementation](<https://aka.ms/kosmos-2>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Random Guess

ROC Box Score: 50. Result ID: 699285783a6c3148490f861e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
