List your company

ResearchFormerly WizWand

RareBench

Benchmarks

TaskDatasetSOTA resultTrendResults

Rare Disease Diagnosis

RareBench RAMEDIS

73.23Recall@1

21

Rare Disease Diagnosis

RareBench LIRICAL

55.95R@1

21

Rare Disease Diagnosis

RareBench HMS

56.97Recall@1

21

Rare Disease Diagnosis

RareBench MME

77.5R@1

21

Medical Diagnosis

RareBench Dirichlet α=0.3 partition

68Accuracy

18

Text-to-Image Generation

RareBench (test)

97.5Property Score

15

Text-to-image alignment

RareBench v1 (test)

96.9Property Alignment

11

Text-to-image alignment

RareBench

96.3Property (Single Object)

11

Rare disease diagnosis from phenotypes

RareBench-Public Phenotypes

37.92Accuracy

9

Clinical diagnosis

RareBench HMS subset n=88

51.14Recall@1

7

Clinical diagnosis retrieval

RareBench MME n=40

40R@1

7

Clinical diagnosis

RareBench (combined)

39.31Recall@1

7

Clinical Diagnosis

RareBench LIRICAL

36.24Recall@1

7

Rare Disease Diagnosis

RareBench Qwen-0.8B text (test)

85.6Hit@1

5

Text-to-Image Generation

RareBench

7.36Latency (sec)

4

Long-tail Recognition

RareBench

85.6Conditional Hit@1

4

Rare Disease Diagnosis

RareBench

46.79Pass@1

4

Text-to-Image Generation

RareBench Overall

74.5Pick Score

3

Text-to-Image Generation

RareBench Advanced

71.5Pick

3

Text-to-Image Generation

RareBench Basic

95.5Pick Score

3

Text-to-Image Generation

RareBench

76.7Property Score

3

Text-to-Image Synthesis

RareBench (full)

6.395LAION-aesthetic

3

Text-to-Image Generation

RareBench 1.0 (test)

81.9Property Score

3

Biomedical Question Answering

RareBench

—Primary metric

0