# R3

Source: [R3](<https://www.sota2.com/research/dataset/r3>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 7. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/dataset/r3.md?page=2>): Follow this link to discover more pages.

- [Text-to-Image Retrieval on Flickr30K](<https://www.sota2.com/research/sota/text-to-image-retrieval-on-flickr30k.md>): Text-to-Image Retrieval; Flickr30K.

- [Text-to-Image Retrieval on Flickr30k (test)](<https://www.sota2.com/research/sota/text-to-image-retrieval-on-flickr30k-test.md>): Text-to-Image Retrieval; Flickr30k (test).

- [Image-to-Text Retrieval on Flickr30K 1K (test)](<https://www.sota2.com/research/sota/image-to-text-retrieval-on-flickr30k-1k-test.md>): Image-to-Text Retrieval; Flickr30K 1K (test).

- [Image-to-Text Retrieval on Flickr30k (test)](<https://www.sota2.com/research/sota/image-to-text-retrieval-on-flickr30k-test.md>): Image-to-Text Retrieval; Flickr30k (test).

- [Image-to-Text Retrieval on Flickr30k](<https://www.sota2.com/research/sota/image-to-text-retrieval-on-flickr30k.md>): Image-to-Text Retrieval; Flickr30k.

- [Text-to-Image Retrieval on Flickr30K 1K (test)](<https://www.sota2.com/research/sota/text-to-image-retrieval-on-flickr30k-1k-test.md>): Text-to-Image Retrieval; Flickr30K 1K (test).

- [Image Retrieval on Flickr30k (test)](<https://www.sota2.com/research/sota/image-retrieval-on-flickr30k-test.md>): Image Retrieval; Flickr30k (test).

- [Text Retrieval on Flickr30K (test) using ASR Metrics](<https://www.sota2.com/research/sota/text-retrieval-on-flickr30k-test-using-asr-metrics.md>): Text Retrieval; Flickr30K (test).

- [Text Retrieval on Flickr30K (test)](<https://www.sota2.com/research/sota/text-retrieval-on-flickr30k-test.md>): Text Retrieval; Flickr30K (test).

- [Image Retrieval on Flickr30K](<https://www.sota2.com/research/sota/image-retrieval-on-flickr30k.md>): Image Retrieval; Flickr30K.

- [Image Captioning on Flickr30k (test)](<https://www.sota2.com/research/sota/image-captioning-on-flickr30k-test.md>): Image Captioning; Flickr30k (test).

- [Text Retrieval on Flickr30K](<https://www.sota2.com/research/sota/text-retrieval-on-flickr30k.md>): Text Retrieval; Flickr30K.

- [Text Retrieval on Flickr30K 1K (test)](<https://www.sota2.com/research/sota/text-retrieval-on-flickr30k-1k-test.md>): Text Retrieval; Flickr30K 1K (test).

- [Image Captioning on Flickr30K (CIDEr)](<https://www.sota2.com/research/sota/image-captioning-on-flickr30k-cider.md>): Image Captioning; Flickr30K.

- [3D Visual Grounding on Nr3D](<https://www.sota2.com/research/sota/3d-visual-grounding-on-nr3d.md>): 3D Visual Grounding; Nr3D.

- [Text-to-Image Retrieval on Flickr30K-CN](<https://www.sota2.com/research/sota/text-to-image-retrieval-on-flickr30k-cn.md>): Text-to-Image Retrieval; Flickr30K-CN.

- [Image Retrieval on Flickr30K 1K (test)](<https://www.sota2.com/research/sota/image-retrieval-on-flickr30k-1k-test.md>): Image Retrieval; Flickr30K 1K (test).

- [Image-to-Text Retrieval on Flickr30K-CN](<https://www.sota2.com/research/sota/image-to-text-retrieval-on-flickr30k-cn.md>): Image-to-Text Retrieval; Flickr30K-CN.

- [3D Visual Grounding on Nr3D (test)](<https://www.sota2.com/research/sota/3d-visual-grounding-on-nr3d-test.md>): 3D Visual Grounding; Nr3D (test).

- [Image Captioning on Flickr30K (Karpathy split)](<https://www.sota2.com/research/sota/image-captioning-on-flickr30k-karpathy-split.md>): Image Captioning; Flickr30K (Karpathy split).

- [3D Visual Grounding on Sr3D (test)](<https://www.sota2.com/research/sota/3d-visual-grounding-on-sr3d-test.md>): 3D Visual Grounding; Sr3D (test).

- [Text-to-Image Retrieval on Flickr30k (val)](<https://www.sota2.com/research/sota/text-to-image-retrieval-on-flickr30k-val.md>): Text-to-Image Retrieval; Flickr30k (val).

- [Image-to-Text Retrieval on Flickr30k (val)](<https://www.sota2.com/research/sota/image-to-text-retrieval-on-flickr30k-val.md>): Image-to-Text Retrieval; Flickr30k (val).

- [Text-to-image Retrieval on Flickr30k (1K)](<https://www.sota2.com/research/sota/text-to-image-retrieval-on-flickr30k-1k.md>): Text-to-image Retrieval; Flickr30k (1K).

- [Financial Safety Evaluation on FinRED R3: Misinformation](<https://www.sota2.com/research/sota/financial-safety-evaluation-on-finred-r3-misinformation.md>): Financial Safety Evaluation; FinRED R3: Misinformation.

- [Image-to-text retrieval on Flickr30K 1K Karpathy (test)](<https://www.sota2.com/research/sota/image-to-text-retrieval-on-flickr30k-1k-karpathy-test.md>): Image-to-text retrieval; Flickr30K 1K Karpathy (test).

- [Anomaly Detection on Brain Tumor Br35H5 (test)](<https://www.sota2.com/research/sota/anomaly-detection-on-brain-tumor-br35h5-test.md>): Anomaly Detection; Brain Tumor Br35H5 (test).

- [Image Captioning on Flickr30k (BLEU-4, METEOR, CIDEr, SPICE)](<https://www.sota2.com/research/sota/image-captioning-on-flickr30k-bleu-4-meteor-cider-spice.md>): Image Captioning; Flickr30k.

- [Image Retrieval on Flickr30k (Recall and Bias Metrics)](<https://www.sota2.com/research/sota/image-retrieval-on-flickr30k-recall-and-bias-metrics.md>): Image Retrieval; Flickr30k.

- [Adversarial Attack on Flickr30K](<https://www.sota2.com/research/sota/adversarial-attack-on-flickr30k.md>): Adversarial Attack; Flickr30K.

- [Vehicle Re-Identification on MSVR310](<https://www.sota2.com/research/sota/vehicle-re-identification-on-msvr310.md>): Vehicle Re-Identification; MSVR310.

- [Radioisotope identification on LaBr3 target-domain sim-to-real (test)](<https://www.sota2.com/research/sota/radioisotope-identification-on-labr3-target-domain-sim-to-real-test.md>): Radioisotope identification; LaBr3 target-domain sim-to-real (test).

- [Reward Modeling on Aggregate Benchmark Suite (HelpSteer3, Reward Bench V2, SCAN-HPD, HREF, LitBench, WQ\_Arena, WPB)](<https://www.sota2.com/research/sota/reward-modeling-on-aggregate-benchmark-suite-helpsteer3-reward-bench-v2-scan-hpd-href-litbench-wq_arena-wpb.md>): Reward Modeling; Aggregate of 7 benchmarks (HelpSteer3, Reward Bench V2, SCAN-HPD, HREF, LitBench, WQ\_Arena, WPB).

- [Anomaly Detection on Br35H](<https://www.sota2.com/research/sota/anomaly-detection-on-br35h.md>): Anomaly Detection; Br35H.

- [Image-text retrieval on Flickr30K (test)](<https://www.sota2.com/research/sota/image-text-retrieval-on-flickr30k-test.md>): Image-text retrieval; Flickr30K (test).

- [Image-to-Text Retrieval on Flickr30K (TR@1, TR@5, TR@10)](<https://www.sota2.com/research/sota/image-to-text-retrieval-on-flickr30k-tr-at-1-tr-at-5-tr-at-10.md>): Image-to-Text Retrieval; Flickr30K.

- [Preference Prediction on Composite Dataset (Arena-Expert-5K, HelpSteer3, HH-RLHF, UltraFeedback)](<https://www.sota2.com/research/sota/preference-prediction-on-composite-dataset-arena-expert-5k-helpsteer3-hh-rlhf-ultrafeedback.md>): Preference Prediction; Arena-Expert-5K, HelpSteer3, HH-RLHF, and UltraFeedback (held-out).

- [Image-Text Retrieval on Flickr30K (R@1)](<https://www.sota2.com/research/sota/image-text-retrieval-on-flickr30k-r-at-1.md>): Image-Text Retrieval; Flickr30K.

- [Image Annotation on Flickr30k (test)](<https://www.sota2.com/research/sota/image-annotation-on-flickr30k-test.md>): Image Annotation; Flickr30k (test).

- [Prompt Injection Defense on AgentDojo R1–R3](<https://www.sota2.com/research/sota/prompt-injection-defense-on-agentdojo-r1-r3.md>): Prompt Injection Defense; AgentDojo R1–R3.

- [Caption Retrieval on Flickr30k (test)](<https://www.sota2.com/research/sota/caption-retrieval-on-flickr30k-test.md>): Caption Retrieval; Flickr30k (test).

- [Multi-modal Vehicle Re-Identification on MSVR310 (test)](<https://www.sota2.com/research/sota/multi-modal-vehicle-re-identification-on-msvr310-test.md>): Multi-modal Vehicle Re-Identification; MSVR310 (test).

- [Phrase Localization on Flickr30K Entities (test)](<https://www.sota2.com/research/sota/phrase-localization-on-flickr30k-entities-test.md>): Phrase Localization; Flickr30K Entities (test).

- [3D Dense Captioning on Nr3D](<https://www.sota2.com/research/sota/3d-dense-captioning-on-nr3d.md>): 3D dense captioning; Nr3D.

- [Multi-task Adversarial Attack Evaluation on COCO, Flickr30k, TextVQA, VQAv2, POPE](<https://www.sota2.com/research/sota/multi-task-adversarial-attack-evaluation-on-coco-flickr30k-textvqa-vqav2-pope.md>): Multi-task Adversarial Attack Evaluation; COCO, Flickr30k, TextVQA, VQAv2, POPE.

- [Image-text grounding on Flickr30K](<https://www.sota2.com/research/sota/image-text-grounding-on-flickr30k.md>): Image-text grounding; Flickr30K.

- [Text Retrieval on Flickr30k Karpathy (test)](<https://www.sota2.com/research/sota/text-retrieval-on-flickr30k-karpathy-test.md>): Text Retrieval; Flickr30k Karpathy (test).

- [Sentence Retrieval on Flickr30K](<https://www.sota2.com/research/sota/sentence-retrieval-on-flickr30k.md>): Sentence Retrieval; Flickr30K.

- [Point Cloud Registration on Color3DMatch (C3DM)](<https://www.sota2.com/research/sota/point-cloud-registration-on-color3dmatch-c3dm.md>): Point Cloud Registration; Color3DMatch (C3DM).

- [Untargeted Adversarial Attack on Flickr30K 1,000 images (test)](<https://www.sota2.com/research/sota/untargeted-adversarial-attack-on-flickr30k-1-000-images-test.md>): Untargeted Adversarial Attack; Flickr30K 1,000 images (test).

- [Untargeted Adversarial Attack on Flickr30K](<https://www.sota2.com/research/sota/untargeted-adversarial-attack-on-flickr30k.md>): Untargeted Adversarial Attack; Flickr30K.

- [Optic Disc Segmentation on RIM-ONE r3](<https://www.sota2.com/research/sota/optic-disc-segmentation-on-rim-one-r3.md>): Optic Disc Segmentation; RIM-ONE r3.

- [Text Retrieval on Flickr30K (1K)](<https://www.sota2.com/research/sota/text-retrieval-on-flickr30k-1k.md>): Text Retrieval; Flickr30K (1K).

- [Text Retrieval on Flickr30k Zero-shot (test)](<https://www.sota2.com/research/sota/text-retrieval-on-flickr30k-zero-shot-test.md>): Text Retrieval; Flickr30k Zero-shot (test).

- [Image-to-text Retrieval on Flickr30k (1K)](<https://www.sota2.com/research/sota/image-to-text-retrieval-on-flickr30k-1k.md>): Image-to-text Retrieval; Flickr30k (1K).

- [Modality Retrieval on Flickr30k](<https://www.sota2.com/research/sota/modality-retrieval-on-flickr30k.md>): Modality Retrieval; Flickr30k.

- [Visual Grounding on Flickr30k Entities (test)](<https://www.sota2.com/research/sota/visual-grounding-on-flickr30k-entities-test.md>): Visual Grounding; Flickr30k Entities (test).

- [Natural Language Inference on ANLI R3 1.0 (test)](<https://www.sota2.com/research/sota/natural-language-inference-on-anli-r3-1-0-test.md>): Natural Language Inference; ANLI R3 1.0 (test).

- [Text-to-image retrieval on Flickr30K 84 (test)](<https://www.sota2.com/research/sota/text-to-image-retrieval-on-flickr30k-84-test.md>): Text-to-image retrieval; Flickr30K 84 (test).

- [Image-to-text Retrieval on Flickr30K 84 (test)](<https://www.sota2.com/research/sota/image-to-text-retrieval-on-flickr30k-84-test.md>): Image-to-text retrieval; Flickr30K 84 (test).

- [Phrase grounding on Flickr30k Entities (test)](<https://www.sota2.com/research/sota/phrase-grounding-on-flickr30k-entities-test.md>): Phrase grounding; Flickr30k Entities (test).

- [Omnidirectional Image Super-Resolution on Flickr360 (test)](<https://www.sota2.com/research/sota/omnidirectional-image-super-resolution-on-flickr360-test.md>): Omnidirectional Image Super-Resolution; Flickr360 (test).

- [3D Visual Grounding on Sr3D](<https://www.sota2.com/research/sota/3d-visual-grounding-on-sr3d.md>): 3D Visual Grounding; Sr3D.

- [Sentence Retrieval on Flickr30K 1K (test)](<https://www.sota2.com/research/sota/sentence-retrieval-on-flickr30k-1k-test.md>): Sentence Retrieval; Flickr30K 1K (test).

- [Natural Language Inference on ANLI R3 (test)](<https://www.sota2.com/research/sota/natural-language-inference-on-anli-r3-test.md>): Natural Language Inference; ANLI R3 (test).

- [Phrase Grounding on Flickr30k entities (val)](<https://www.sota2.com/research/sota/phrase-grounding-on-flickr30k-entities-val.md>): Phrase Grounding; Flickr30k entities (val).

- [Targeted Adversarial Attack on Flickr30K 1,000 images (test)](<https://www.sota2.com/research/sota/targeted-adversarial-attack-on-flickr30k-1-000-images-test.md>): Targeted Adversarial Attack; Flickr30K 1,000 images (test).

- [Targeted Adversarial Attack on Flickr30K](<https://www.sota2.com/research/sota/targeted-adversarial-attack-on-flickr30k.md>): Targeted Adversarial Attack; Flickr30K.

- [Image-to-Text Retrieval on Flickr30K (I→T@1)](<https://www.sota2.com/research/sota/image-to-text-retrieval-on-flickr30k-i-t-at-1.md>): Image-to-Text Retrieval; Flickr30K.

- [Cross-modal Retrieval on Flickr30k (test)](<https://www.sota2.com/research/sota/cross-modal-retrieval-on-flickr30k-test.md>): Cross-modal Retrieval; Flickr30k (test).

- [OC/OD segmentation on RIM-ONE r3 Domain D (unseen)](<https://www.sota2.com/research/sota/oc-od-segmentation-on-rim-one-r3-domain-d-unseen.md>): OC/OD segmentation; RIM-ONE r3 Domain D (unseen).

- [Image-Text Retrieval on Flickr30K (I-T, T-I, Rsum)](<https://www.sota2.com/research/sota/image-text-retrieval-on-flickr30k-i-t-t-i-rsum.md>): Image-Text Retrieval; Flickr30K.

- [Image-to-Text Retrieval on Flickr30k (Adversarial ASR Metrics)](<https://www.sota2.com/research/sota/image-to-text-retrieval-on-flickr30k-adversarial-asr-metrics.md>): Image-to-Text Retrieval; Flickr30k.

- [Text-to-Image Retrieval on Flickr30k (Robustness Metrics)](<https://www.sota2.com/research/sota/text-to-image-retrieval-on-flickr30k-robustness-metrics.md>): Text-to-Image Retrieval; Flickr30k.

- [Super-Resolution on Flickr360 3 (val)](<https://www.sota2.com/research/sota/super-resolution-on-flickr360-3-val.md>): Super-Resolution; Flickr360 3 (val).

- [AI-generated image detection on AIGIBench R3GAN](<https://www.sota2.com/research/sota/ai-generated-image-detection-on-aigibench-r3gan.md>): AI-generated image detection; AIGIBench R3GAN.

- [Camera Tracking on TUM RGB-D fr3/office](<https://www.sota2.com/research/sota/camera-tracking-on-tum-rgb-d-fr3-office.md>): Camera Tracking; TUM RGB-D fr3/office.

- [Caption Retrieval on Flickr30k](<https://www.sota2.com/research/sota/caption-retrieval-on-flickr30k.md>): Caption Retrieval; Flickr30k.

- [Image Captioning on Flickr30k (CIDEr, Normalized CIDEr)](<https://www.sota2.com/research/sota/image-captioning-on-flickr30k-cider-normalized-cider.md>): Image Captioning; Flickr30k.

- [Disentanglement on Falcor3D](<https://www.sota2.com/research/sota/disentanglement-on-falcor3d.md>): Disentanglement; Falcor3D.