Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

MERLIN dataset and benchmarks · SOTA2 Research

Research Datasets

MERLIN

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Natural Language Generation

Merlin

0.39BLEU-1

14

Medical Report Generation

Merlin (test)

35.64RaTE Score

14

RadBERT classification

Merlin dataset

52.63Micro Precision

14

Text-to-image retrieval

Merlin-Abd-CT

65.25Recall@1

13

Image-to-text retrieval

Merlin-Abd-CT

64Recall@1

13

Abnormality Detection

Merlin-Abd-CT

82.44AUROC

12

Text-to-Image Retrieval

Merlin Impressions section (test)

43.2Recall@1

12

Text-to-Image Retrieval

Merlin Findings section (test)

77.6Recall@1

12

Text-to-image retrieval

Merlin (val)

70.7Recall@1 (Findings)

9

Metric Correlation with Human Judgment

Merlin

0.369Pearson Correlation

7

Text-to-Image Retrieval

Merlin Full Report (test)

66.4Recall@1

6

Medical finding classification

MERLIN (test)

0.83AUROC

6

Merlin

81AUROC

5

Abnormality diagnosis

Merlin (internal val)

84.3F1 Score

5

Report retrieval

Merlin

88.8Recall@1

4

Disease Classification

Merlin (test)

86.9Precision

4

Abdominal Pathology Classification

MERLIN N = 5,082 (Internal)

88AUC

4

Medical Report Generation

Merlin

9BLEU-2

3

Report-to-volume retrieval

Merlin n=5,082

22.5Recall@5

3

Object Existence Verification

Merlin Images (random)

48.6Pos-Orig Score

2

Object Existence Verification

Merlin Curated Images

34.3Positive Original Accuracy

2

Quantitative Phenotyping

MERLIN

71.3AP

2

Medical Report Generation

Merlin neg

60.5BLEU-2

1

Medical Report Generation

Merlin pos

29.8BLEU-2

1

Popular tasks

Text-to-Image Retrieval Medical Report Generation Object Existence Verification Classification Image-to-Text Retrieval

Follow for updates

Join SOTA2 Contact