# Multimodal Referring and Grounding on Ferret-Bench v1.0 (test)

Source: [Multimodal Referring and Grounding on Ferret-Bench v1.0 (test)](<https://www.sota2.com/research/sota/multimodal-referring-and-grounding-on-ferret-bench-v1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:01:47.491Z

Evaluation of multimodal referring and grounding capabilities using the test split of Ferret-Bench v1.0, covering description, reasoning, and conversational grounding metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multimodal Referring and Grounding |
| Dataset (including any stated split) | Ferret-Bench v1.0 (test) |
| Metric | Referring Description |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Referring Description](<https://www.sota2.com/research/sota/multimodal-referring-and-grounding-on-ferret-bench-v1-0-test.md?metric=Referring%20Description>): Higher is better; unit: PERCENT.

- [Referring Reasoning](<https://www.sota2.com/research/sota/multimodal-referring-and-grounding-on-ferret-bench-v1-0-test.md?metric=Referring%20Reasoning>): Higher is better; unit: PERCENT.

- [Grounding in Conversation](<https://www.sota2.com/research/sota/multimodal-referring-and-grounding-on-ferret-bench-v1-0-test.md?metric=Grounding%20in%20Conversation>): Higher is better; unit: PERCENT.

- [Average Score](<https://www.sota2.com/research/sota/multimodal-referring-and-grounding-on-ferret-bench-v1-0-test.md?metric=Average%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Referring Description | Result date | Report paper |
| --- | --- | --- | --- |
| Ferret-v2-7B | 79.9 | Not recorded | 68fa72df1e209131cea5914a |
| Ferret-v2-13B | 79.6 | Not recorded | 68fa72df1e209131cea5914a |
| Osprey-7B | 72.2 | Not recorded | 68fa72df1e209131cea5914a |
| Ferret-13B | 70.6 | Not recorded | 68fa72df1e209131cea5914a |
| Ferret-7B | 68.7 | Not recorded | 68fa72df1e209131cea5914a |
| CogVLM-17B | 67.1 | Not recorded | 68fa72df1e209131cea5914a |
| SPHINX-2k | 55.6 | Not recorded | 68fa72df1e209131cea5914a |
| Kosmos-2 | 51.8 | Not recorded | 68fa72df1e209131cea5914a |
| Shikra-7B | 46 | Not recorded | 68fa72df1e209131cea5914a |
| LLaVA | 41.4 | Not recorded | 68fa72df1e209131cea5914a |

### Ferret-v2-7B

Referring Description: 79.9. Result ID: 699285783a6c3148490f861b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

Recorded evaluation configuration: {"Parameter Size":"7B"}. This record does not assert independent reproduction.

### Ferret-v2-13B

Referring Description: 79.6. Result ID: 699285783a6c3148490f861d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

Recorded evaluation configuration: {"Parameter Size":"13B"}. This record does not assert independent reproduction.

### Osprey-7B

Referring Description: 72.2. Result ID: 699285783a6c3148490f8618.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b1f1e209131cea86abf.md>)

[Implementation](<https://github.com/CircleRadon/Osprey>)

Recorded evaluation configuration: {"Parameter Size":"7B"}. This record does not assert independent reproduction.

### Ferret-13B

Referring Description: 70.6. Result ID: 699285783a6c3148490f861c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70d81e209131cea4da64.md>)

Recorded evaluation configuration: {"Parameter Size":"13B"}. This record does not assert independent reproduction.

### Ferret-7B

Referring Description: 68.7. Result ID: 699285783a6c3148490f861a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70d81e209131cea4da64.md>)

Recorded evaluation configuration: {"Parameter Size":"7B"}. This record does not assert independent reproduction.

### CogVLM-17B

Referring Description: 67.1. Result ID: 699285783a6c3148490f8617.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa721c1e209131cea548b9.md>)

[Implementation](<https://github.com/THUDM/CogVLM>)

Recorded evaluation configuration: {"Parameter Size":"17B"}. This record does not assert independent reproduction.

### SPHINX-2k

Referring Description: 55.6. Result ID: 699285783a6c3148490f8619.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa712e1e209131cea4fc54.md>)

[Implementation](<https://github.com/Alpha-VLLM/LLaMA2-Accessory>)

Recorded evaluation configuration: {"Resolution":"2k"}. This record does not assert independent reproduction.

### Kosmos-2

Referring Description: 51.8. Result ID: 699285783a6c3148490f8615.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa700a1e209131cea48c7f.md>)

[Implementation](<https://aka.ms/kosmos-2>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Shikra-7B

Referring Description: 46. Result ID: 699285783a6c3148490f8616.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fe61e209131cea47fbc.md>)

[Implementation](<https://github.com/shikras/shikra>)

Recorded evaluation configuration: {"Parameter Size":"7B"}. This record does not assert independent reproduction.

### LLaVA

Referring Description: 41.4. Result ID: 699285783a6c3148490f8614.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72df1e209131cea5914a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa717d1e209131cea51970.md>)

[Implementation](<https://llava-vl.github.io/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
