# Referring Audio-Visual Segmentation on Ref-AVS (unseen) Source: [Referring Audio-Visual Segmentation on Ref-AVS (unseen)]() Collection index: [llms.txt]() Data updated: 2026-05-15T09:07:27.324Z Evaluation of Referring Audio-Visual Segmentation performance on the unseen split of the Ref-AVS dataset, reporting Jaccard (J), F-score (F), and J&F metrics. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Referring Audio-Visual Segmentation | | Dataset (including any stated split) | Ref-AVS (unseen) | | Metric | Jaccard Index (J) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Jaccard Index (J)](): Higher is better; unit: PERCENT. - [F-Score (F)](): Higher is better; unit: PERCENT. - [Jaccard & F-Score (J&F)](): Higher is better; unit: PERCENT. ## Recorded results | Method | Jaccard Index (J) | Result date | Report paper | | --- | --- | --- | --- | | TGS-Agent | 73.2 | Not recorded | 6a016256dbc836b87d822ea8 | | PRIMED | 71.8 | Not recorded | 6a016256dbc836b87d822ea8 | | Omni-R1 | 71.3 | Not recorded | 6a016256dbc836b87d822ea8 | | AURORA | 69.7 | Not recorded | 6a016256dbc836b87d822ea8 | | Ours AuralSAM2 | 68.69 | Not recorded | 68fa78ff1e209131cea7b8f0 | | SAM2-LOVE | 66.5 | Not recorded | 6a016256dbc836b87d822ea8 | | SAM2-LOVE | 66.5 | Not recorded | 68fa78ff1e209131cea7b8f0 | | Ours AuralSAM2 | 63.45 | Not recorded | 68fa78ff1e209131cea7b8f0 | | SAMA-AVS† | 60.6 | Not recorded | 68fa78ff1e209131cea7b8f0 | | GroundedSAM2\* | 59.8 | Not recorded | 68fa78ff1e209131cea7b8f0 | | GAVS† | 59.2 | Not recorded | 68fa78ff1e209131cea7b8f0 | | OISA-1B | 58.3 | Not recorded | 6a016256dbc836b87d822ea8 | | Ours SAM (w/ AuralFuser) | 57.91 | Not recorded | 68fa78ff1e209131cea7b8f0 | | TSAM | 54.6 | Not recorded | 6a016256dbc836b87d822ea8 | | TSAM | 54.6 | Not recorded | 68fa78ff1e209131cea7b8f0 | | VoCa | 51.7 | Not recorded | 6a016256dbc836b87d822ea8 | | EEMC | 49.54 | Not recorded | 68fa78ff1e209131cea7b8f0 | | EEMC | 49.5 | Not recorded | 6a016256dbc836b87d822ea8 | | SAMA-AVS | 47.5 | Not recorded | 68fa78ff1e209131cea7b8f0 | | Crab | 45.6 | Not recorded | 6a016256dbc836b87d822ea8 | | AVSegFormer | 36.1 | Not recorded | 6a016256dbc836b87d822ea8 | | AVSegFormer | 36.05 | Not recorded | 68fa78ff1e209131cea7b8f0 | | AVSBench | 32.4 | Not recorded | 6a016256dbc836b87d822ea8 | | TPAVI | 32.36 | Not recorded | 68fa78ff1e209131cea7b8f0 | | ReferFormer | 30.4 | Not recorded | 6a016256dbc836b87d822ea8 | | GAVS | 29.8 | Not recorded | 6a016256dbc836b87d822ea8 | | GAVS | 29.8 | Not recorded | 68fa78ff1e209131cea7b8f0 | | R2VOS | 27.9 | Not recorded | 6a016256dbc836b87d822ea8 | ### TGS-Agent Jaccard Index (J): 73.2. Result ID: 6a0192da47f34ce924e36329. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"Ref-AVS"}. This record does not assert independent reproduction. ### PRIMED Jaccard Index (J): 71.8. Result ID: 6a0192da47f34ce924e3632d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"Ours"}. This record does not assert independent reproduction. ### Omni-R1 Jaccard Index (J): 71.3. Result ID: 6a0192da47f34ce924e3632b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"Omni-Reasoning"}. This record does not assert independent reproduction. ### AURORA Jaccard Index (J): 69.7. Result ID: 6a0192da47f34ce924e3632c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"Ref-AVS"}. This record does not assert independent reproduction. ### Ours AuralSAM2 Jaccard Index (J): 68.69. Result ID: 6a06e24047f34ce924eec008. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Hiera-l"}. This record does not assert independent reproduction. ### SAM2-LOVE Jaccard Index (J): 66.5. Result ID: 6a0192da47f34ce924e36326. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"Ref-AVS"}. This record does not assert independent reproduction. ### SAM2-LOVE Jaccard Index (J): 66.5. Result ID: 6a06e24047f34ce924eec006. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Hiera-l"}. This record does not assert independent reproduction. ### Ours AuralSAM2 Jaccard Index (J): 63.45. Result ID: 6a06e24047f34ce924eec007. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Hiera-b+"}. This record does not assert independent reproduction. ### SAMA-AVS† Jaccard Index (J): 60.6. Result ID: 6a06e24047f34ce924eec005. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Hiera-b+","reimplementation":"true"}. This record does not assert independent reproduction. ### GroundedSAM2\* Jaccard Index (J): 59.8. Result ID: 6a06e24047f34ce924eec003. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Hiera-b+","utilising SAM's zero-shot capability":"true"}. This record does not assert independent reproduction. ### GAVS† Jaccard Index (J): 59.2. Result ID: 6a06e24047f34ce924eec004. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Hiera-b+","reimplementation":"true"}. This record does not assert independent reproduction. ### OISA-1B Jaccard Index (J): 58.3. Result ID: 6a0192da47f34ce924e3632a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"Omni-AVS"}. This record does not assert independent reproduction. ### Ours SAM (w/ AuralFuser) Jaccard Index (J): 57.91. Result ID: 6a06e24047f34ce924eec002. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"ViT-h"}. This record does not assert independent reproduction. ### TSAM Jaccard Index (J): 54.6. Result ID: 6a0192da47f34ce924e36327. [Reporting paper]() Recorded evaluation configuration: {"Task":"Ref-AVS"}. This record does not assert independent reproduction. ### TSAM Jaccard Index (J): 54.6. Result ID: 6a06e24047f34ce924eec001. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"ViT-h"}. This record does not assert independent reproduction. ### VoCa Jaccard Index (J): 51.7. Result ID: 6a0192da47f34ce924e36325. [Reporting paper]() Recorded evaluation configuration: {"Task":"Ref-AVS"}. This record does not assert independent reproduction. ### EEMC Jaccard Index (J): 49.54. Result ID: 6a06e24047f34ce924eebffe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Swin-b"}. This record does not assert independent reproduction. ### EEMC Jaccard Index (J): 49.5. Result ID: 6a0192da47f34ce924e36324. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"Ref-AVS"}. This record does not assert independent reproduction. ### SAMA-AVS Jaccard Index (J): 47.5. Result ID: 6a06e24047f34ce924eec000. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ViT-h"}. This record does not assert independent reproduction. ### Crab Jaccard Index (J): 45.6. Result ID: 6a0192da47f34ce924e36328. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Task":"Ref-AVS"}. This record does not assert independent reproduction. ### AVSegFormer Jaccard Index (J): 36.1. Result ID: 6a0192da47f34ce924e36320. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"AVS\*"}. This record does not assert independent reproduction. ### AVSegFormer Jaccard Index (J): 36.05. Result ID: 6a06e24047f34ce924eebffd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"PVT-v2"}. This record does not assert independent reproduction. ### AVSBench Jaccard Index (J): 32.4. Result ID: 6a0192da47f34ce924e3631f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"AVS\*"}. This record does not assert independent reproduction. ### TPAVI Jaccard Index (J): 32.36. Result ID: 6a06e24047f34ce924eebffc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"PVT-v2"}. This record does not assert independent reproduction. ### ReferFormer Jaccard Index (J): 30.4. Result ID: 6a0192da47f34ce924e36322. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Task":"Ref-VOS\*"}. This record does not assert independent reproduction. ### GAVS Jaccard Index (J): 29.8. Result ID: 6a0192da47f34ce924e36321. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Task":"AVS\*"}. This record does not assert independent reproduction. ### GAVS Jaccard Index (J): 29.8. Result ID: 6a06e24047f34ce924eebfff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"ViT-h"}. This record does not assert independent reproduction. ### R2VOS Jaccard Index (J): 27.9. Result ID: 6a0192da47f34ce924e36323. [Reporting paper]() Recorded evaluation configuration: {"Task":"Ref-VOS\*"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.