# Referring Object Classification on SA-refer in-the-wild

Source: [Referring Object Classification on SA-refer in-the-wild](<https://www.sota2.com/research/sota/referring-object-classification-on-sa-refer-in-the-wild>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:34:11.241Z

Evaluation of Referring Object Classification performance on the SA-refer in-the-wild dataset, measured using Point, Box, and Free-form metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Referring Object Classification |
| Dataset (including any stated split) | SA-refer in-the-wild |
| Metric | Accuracy (Box) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy (Box)](<https://www.sota2.com/research/sota/referring-object-classification-on-sa-refer-in-the-wild.md?metric=Accuracy%20(Box)>): Higher is better; unit: PERCENT.

- [Accuracy (Point)](<https://www.sota2.com/research/sota/referring-object-classification-on-sa-refer-in-the-wild.md?metric=Accuracy%20(Point)>): Higher is better; unit: PERCENT.

- [Accuracy (Free-form)](<https://www.sota2.com/research/sota/referring-object-classification-on-sa-refer-in-the-wild.md?metric=Accuracy%20(Free-form)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy (Box) | Result date | Report paper |
| --- | --- | --- | --- |
| Ferret-v2 | 69.49 | Not recorded | 68fa72df1e209131cea5914a |
| Ferret-v2 | 68.83 | Not recorded | 68fa72df1e209131cea5914a |
| SPHINX-2k | 63.39 | Not recorded | 68fa72df1e209131cea5914a |
| Ferret | 63.35 | Not recorded | 68fa72df1e209131cea5914a |
| Ferret | 62.99 | Not recorded | 68fa72df1e209131cea5914a |
| CogVLM | 61.77 | Not recorded | 68fa72df1e209131cea5914a |
| Shikra | 56.82 | Not recorded | 68fa72df1e209131cea5914a |
| GPT4-ROI | 55.02 | Not recorded | 68fa72df1e209131cea5914a |
| Kosmos-2 | 53.97 | Not recorded | 68fa72df1e209131cea5914a |
| Random Guess | 50 | Not recorded | 68fa72df1e209131cea5914a |

### Ferret-v2

Accuracy (Box): 69.49. Result ID: 699285783a6c3148490f8631.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

Recorded evaluation configuration: {"Size":"13B"}. This record does not assert independent reproduction.

### Ferret-v2

Accuracy (Box): 68.83. Result ID: 699285783a6c3148490f862f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

Recorded evaluation configuration: {"Size":"7B"}. This record does not assert independent reproduction.

### SPHINX-2k

Accuracy (Box): 63.39. Result ID: 699285783a6c3148490f862d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa712e1e209131cea4fc54.md>)

[Implementation](<https://github.com/Alpha-VLLM/LLaMA2-Accessory>)

Recorded evaluation configuration: {"Resolution":"2k"}. This record does not assert independent reproduction.

### Ferret

Accuracy (Box): 63.35. Result ID: 699285783a6c3148490f8630.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70d81e209131cea4da64.md>)

Recorded evaluation configuration: {"Size":"13B"}. This record does not assert independent reproduction.

### Ferret

Accuracy (Box): 62.99. Result ID: 699285783a6c3148490f862e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70d81e209131cea4da64.md>)

Recorded evaluation configuration: {"Size":"7B"}. This record does not assert independent reproduction.

### CogVLM

Accuracy (Box): 61.77. Result ID: 699285783a6c3148490f862c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa721c1e209131cea548b9.md>)

[Implementation](<https://github.com/THUDM/CogVLM>)

Recorded evaluation configuration: {"Size":"17B"}. This record does not assert independent reproduction.

### Shikra

Accuracy (Box): 56.82. Result ID: 699285783a6c3148490f862a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fe61e209131cea47fbc.md>)

[Implementation](<https://github.com/shikras/shikra>)

Recorded evaluation configuration: {"Size":"7B"}. This record does not assert independent reproduction.

### GPT4-ROI

Accuracy (Box): 55.02. Result ID: 699285783a6c3148490f862b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa794e1e209131cea7d037.md>)

[Implementation](<https://github.com/jshilong/GPT4RoI>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Kosmos-2

Accuracy (Box): 53.97. Result ID: 699285783a6c3148490f8629.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa700a1e209131cea48c7f.md>)

[Implementation](<https://aka.ms/kosmos-2>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Random Guess

Accuracy (Box): 50. Result ID: 699285783a6c3148490f8628.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
