# Referring Audio-Visual Segmentation on Ref-AVS (mix) Source: [Referring Audio-Visual Segmentation on Ref-AVS (mix)]() Collection index: [llms.txt]() Data updated: 2026-05-15T09:07:27.355Z Evaluation of Referring Audio-Visual Segmentation performance on the mixed split of the Ref-AVS dataset, reporting Jaccard (J), F-score (F), and J&F metrics. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Referring Audio-Visual Segmentation | | Dataset (including any stated split) | Ref-AVS (mix) | | Metric | Jaccard Index (J) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Jaccard Index (J)](): Higher is better; unit: PERCENT. - [F-score (F)](): Higher is better; unit: PERCENT. - [Jaccard & F-score (J&F)](): Higher is better; unit: PERCENT. ## Recorded results | Method | Jaccard Index (J) | Result date | Report paper | | --- | --- | --- | --- | | PRIMED | 68.9 | Not recorded | 6a016256dbc836b87d822ea8 | | AURORA | 66.5 | Not recorded | 6a016256dbc836b87d822ea8 | | Ours AuralSAM2 | 62.43 | Not recorded | 68fa78ff1e209131cea7b8f0 | | TGS-Agent | 61.3 | Not recorded | 6a016256dbc836b87d822ea8 | | Ours AuralSAM2 | 58.31 | Not recorded | 68fa78ff1e209131cea7b8f0 | | Omni-R1 | 57.2 | Not recorded | 6a016256dbc836b87d822ea8 | | SAMA-AVS† | 55.1 | Not recorded | 68fa78ff1e209131cea7b8f0 | | SAM2-LOVE | 55 | Not recorded | 6a016256dbc836b87d822ea8 | | SAM2-LOVE | 55 | Not recorded | 68fa78ff1e209131cea7b8f0 | | OISA-1B | 54.5 | Not recorded | 6a016256dbc836b87d822ea8 | | GAVS† | 53.6 | Not recorded | 68fa78ff1e209131cea7b8f0 | | Ours SAM (w/ AuralFuser) | 53.09 | Not recorded | 68fa78ff1e209131cea7b8f0 | | TSAM | 49 | Not recorded | 6a016256dbc836b87d822ea8 | | TSAM | 49 | Not recorded | 68fa78ff1e209131cea7b8f0 | | VoCa | 46.3 | Not recorded | 6a016256dbc836b87d822ea8 | | GroundedSAM2\* | 44.2 | Not recorded | 68fa78ff1e209131cea7b8f0 | | SAMA-AVS | 43.4 | Not recorded | 68fa78ff1e209131cea7b8f0 | | Crab | 43.1 | Not recorded | 6a016256dbc836b87d822ea8 | | EEMC | 41.9 | Not recorded | 6a016256dbc836b87d822ea8 | | EEMC | 41.87 | Not recorded | 68fa78ff1e209131cea7b8f0 | | AVSegFormer | 34.8 | Not recorded | 6a016256dbc836b87d822ea8 | | AVSegFormer | 34.76 | Not recorded | 68fa78ff1e209131cea7b8f0 | | ReferFormer | 30.9 | Not recorded | 6a016256dbc836b87d822ea8 | | GAVS | 29.4 | Not recorded | 6a016256dbc836b87d822ea8 | | GAVS | 29.4 | Not recorded | 68fa78ff1e209131cea7b8f0 | | AVSBench | 27.8 | Not recorded | 6a016256dbc836b87d822ea8 | | TPAVI | 27.78 | Not recorded | 68fa78ff1e209131cea7b8f0 | | R2VOS | 26.5 | Not recorded | 6a016256dbc836b87d822ea8 | ### PRIMED Jaccard Index (J): 68.9. Result ID: 6a0192da47f34ce924e3633c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"Ours"}. This record does not assert independent reproduction. ### AURORA Jaccard Index (J): 66.5. Result ID: 6a0192da47f34ce924e3633b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"Ref-AVS"}. This record does not assert independent reproduction. ### Ours AuralSAM2 Jaccard Index (J): 62.43. Result ID: 6a06e24047f34ce924eec015. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Hiera-l"}. This record does not assert independent reproduction. ### TGS-Agent Jaccard Index (J): 61.3. Result ID: 6a0192da47f34ce924e36338. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"Ref-AVS"}. This record does not assert independent reproduction. ### Ours AuralSAM2 Jaccard Index (J): 58.31. Result ID: 6a06e24047f34ce924eec014. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Hiera-b+"}. This record does not assert independent reproduction. ### Omni-R1 Jaccard Index (J): 57.2. Result ID: 6a0192da47f34ce924e3633a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"Omni-Reasoning"}. This record does not assert independent reproduction. ### SAMA-AVS† Jaccard Index (J): 55.1. Result ID: 6a06e24047f34ce924eec012. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Hiera-b+","reimplementation":"true"}. This record does not assert independent reproduction. ### SAM2-LOVE Jaccard Index (J): 55. Result ID: 6a0192da47f34ce924e36335. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"Ref-AVS"}. This record does not assert independent reproduction. ### SAM2-LOVE Jaccard Index (J): 55. Result ID: 6a06e24047f34ce924eec013. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Hiera-l"}. This record does not assert independent reproduction. ### OISA-1B Jaccard Index (J): 54.5. Result ID: 6a0192da47f34ce924e36339. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"Omni-AVS"}. This record does not assert independent reproduction. ### GAVS† Jaccard Index (J): 53.6. Result ID: 6a06e24047f34ce924eec011. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Hiera-b+","reimplementation":"true"}. This record does not assert independent reproduction. ### Ours SAM (w/ AuralFuser) Jaccard Index (J): 53.09. Result ID: 6a06e24047f34ce924eec00f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-h"}. This record does not assert independent reproduction. ### TSAM Jaccard Index (J): 49. Result ID: 6a0192da47f34ce924e36336. [Reporting paper]() Recorded evaluation configuration: {"Task":"Ref-AVS"}. This record does not assert independent reproduction. ### TSAM Jaccard Index (J): 49. Result ID: 6a06e24047f34ce924eec00e. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ViT-h"}. This record does not assert independent reproduction. ### VoCa Jaccard Index (J): 46.3. Result ID: 6a0192da47f34ce924e36334. [Reporting paper]() Recorded evaluation configuration: {"Task":"Ref-AVS"}. This record does not assert independent reproduction. ### GroundedSAM2\* Jaccard Index (J): 44.2. Result ID: 6a06e24047f34ce924eec010. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Hiera-b+","utilising SAM's zero-shot capability":"true"}. This record does not assert independent reproduction. ### SAMA-AVS Jaccard Index (J): 43.4. Result ID: 6a06e24047f34ce924eec00d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ViT-h"}. This record does not assert independent reproduction. ### Crab Jaccard Index (J): 43.1. Result ID: 6a0192da47f34ce924e36337. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Task":"Ref-AVS"}. This record does not assert independent reproduction. ### EEMC Jaccard Index (J): 41.9. Result ID: 6a0192da47f34ce924e36333. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"Ref-AVS"}. This record does not assert independent reproduction. ### EEMC Jaccard Index (J): 41.87. Result ID: 6a06e24047f34ce924eec00b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Swin-b"}. This record does not assert independent reproduction. ### AVSegFormer Jaccard Index (J): 34.8. Result ID: 6a0192da47f34ce924e3632f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"AVS\*"}. This record does not assert independent reproduction. ### AVSegFormer Jaccard Index (J): 34.76. Result ID: 6a06e24047f34ce924eec00a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"PVT-v2"}. This record does not assert independent reproduction. ### ReferFormer Jaccard Index (J): 30.9. Result ID: 6a0192da47f34ce924e36331. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Task":"Ref-VOS\*"}. This record does not assert independent reproduction. ### GAVS Jaccard Index (J): 29.4. Result ID: 6a0192da47f34ce924e36330. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"AVS\*"}. This record does not assert independent reproduction. ### GAVS Jaccard Index (J): 29.4. Result ID: 6a06e24047f34ce924eec00c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ViT-h"}. This record does not assert independent reproduction. ### AVSBench Jaccard Index (J): 27.8. Result ID: 6a0192da47f34ce924e3632e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"AVS\*"}. This record does not assert independent reproduction. ### TPAVI Jaccard Index (J): 27.78. Result ID: 6a06e24047f34ce924eec009. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"PVT-v2"}. This record does not assert independent reproduction. ### R2VOS Jaccard Index (J): 26.5. Result ID: 6a0192da47f34ce924e36332. [Reporting paper]() Recorded evaluation configuration: {"Task":"Ref-VOS\*"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.