# 3D Tumor Analysis on AbdomenAtlas 3.0 (test)

Source: [3D Tumor Analysis on AbdomenAtlas 3.0 (test)](<https://www.sota2.com/research/sota/3d-tumor-analysis-on-abdomenatlas-3-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-24T07:27:49.959Z

Evaluation of 3D Tumor Analysis performance on the AbdomenAtlas 3.0 test set, reporting detailed sensitivity, specificity, and balanced accuracy metrics across Pancreatic, Kidney, and Liver lesions, stratified by size (\<=2cm vs \>2cm).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | 3D Tumor Analysis |
| Dataset (including any stated split) | AbdomenAtlas 3.0 (test) |
| Metric | Pancreatic Sensitivity (\<=2cm) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Pancreatic Sensitivity (\<=2cm)](<https://www.sota2.com/research/sota/3d-tumor-analysis-on-abdomenatlas-3-0-test.md?metric=Pancreatic%20Sensitivity%20(%3C%3D2cm)>): Higher is better; unit: PERCENT.

- [Pancreatic Sensitivity (\>2cm)](<https://www.sota2.com/research/sota/3d-tumor-analysis-on-abdomenatlas-3-0-test.md?metric=Pancreatic%20Sensitivity%20(%3E2cm)>): Higher is better; unit: PERCENT.

- [Pancreatic Specificity](<https://www.sota2.com/research/sota/3d-tumor-analysis-on-abdomenatlas-3-0-test.md?metric=Pancreatic%20Specificity>): Higher is better; unit: PERCENT.

- [Pancreatic Balanced Accuracy](<https://www.sota2.com/research/sota/3d-tumor-analysis-on-abdomenatlas-3-0-test.md?metric=Pancreatic%20Balanced%20Accuracy>): Higher is better; unit: PERCENT.

- [Kidney Sensitivity (\<=2cm)](<https://www.sota2.com/research/sota/3d-tumor-analysis-on-abdomenatlas-3-0-test.md?metric=Kidney%20Sensitivity%20(%3C%3D2cm)>): Higher is better; unit: PERCENT.

- [Kidney Sensitivity (\>2cm)](<https://www.sota2.com/research/sota/3d-tumor-analysis-on-abdomenatlas-3-0-test.md?metric=Kidney%20Sensitivity%20(%3E2cm)>): Higher is better; unit: PERCENT.

- [Kidney Specificity](<https://www.sota2.com/research/sota/3d-tumor-analysis-on-abdomenatlas-3-0-test.md?metric=Kidney%20Specificity>): Higher is better; unit: PERCENT.

- [Kidney Balanced Accuracy](<https://www.sota2.com/research/sota/3d-tumor-analysis-on-abdomenatlas-3-0-test.md?metric=Kidney%20Balanced%20Accuracy>): Higher is better; unit: PERCENT.

- [Liver Sensitivity (\<=2cm)](<https://www.sota2.com/research/sota/3d-tumor-analysis-on-abdomenatlas-3-0-test.md?metric=Liver%20Sensitivity%20(%3C%3D2cm)>): Higher is better; unit: PERCENT.

- [Liver Sensitivity (\>2cm)](<https://www.sota2.com/research/sota/3d-tumor-analysis-on-abdomenatlas-3-0-test.md?metric=Liver%20Sensitivity%20(%3E2cm)>): Higher is better; unit: PERCENT.

- [Liver Specificity](<https://www.sota2.com/research/sota/3d-tumor-analysis-on-abdomenatlas-3-0-test.md?metric=Liver%20Specificity>): Higher is better; unit: PERCENT.

- [Liver Balanced Accuracy](<https://www.sota2.com/research/sota/3d-tumor-analysis-on-abdomenatlas-3-0-test.md?metric=Liver%20Balanced%20Accuracy>): Higher is better; unit: PERCENT.

- [Average Balanced Accuracy](<https://www.sota2.com/research/sota/3d-tumor-analysis-on-abdomenatlas-3-0-test.md?metric=Average%20Balanced%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Pancreatic Sensitivity (\<=2cm) | Result date | Report paper |
| --- | --- | --- | --- |
| HuluMed-7B | 96.97 | Not recorded | 6a3b64b3206542251d7c97e9 |
| Gemini 3 | 96.67 | Not recorded | 6a3b64b3206542251d7c97e9 |
| Lingshu-7B | 78.79 | Not recorded | 6a3b64b3206542251d7c97e9 |
| SFT+E-MRL | 78.79 | Not recorded | 6a3b64b3206542251d7c97e9 |
| SFT+GRPO (w/ re, rf) | 75.76 | Not recorded | 6a3b64b3206542251d7c97e9 |
| CT-Chat | 66.7 | Not recorded | 6a3b64b3206542251d7c97e9 |
| RadGPT | 66.7 | Not recorded | 6a3b64b3206542251d7c97e9 |
| SFT | 66.67 | Not recorded | 6a3b64b3206542251d7c97e9 |
| SFT+GRPO (w/ re) | 60.61 | Not recorded | 6a3b64b3206542251d7c97e9 |
| GPT-4o-mini | 57.58 | Not recorded | 6a3b64b3206542251d7c97e9 |
| MedVLM-R1-2B | 46.88 | Not recorded | 6a3b64b3206542251d7c97e9 |
| Merlin | 33.3 | Not recorded | 6a3b64b3206542251d7c97e9 |
| M3D | 8.18 | Not recorded | 6a3b64b3206542251d7c97e9 |
| Zero-shot Inference | 6.06 | Not recorded | 6a3b64b3206542251d7c97e9 |
| CT2Rep | 0 | Not recorded | 6a3b64b3206542251d7c97e9 |

### HuluMed-7B

Pancreatic Sensitivity (\<=2cm): 96.97. Result ID: 6a3b86d9fbc373592c4390d7.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bfd1e209131cea8bb56.md>)

Recorded evaluation configuration: {"Category":"2D Medical VLM Models","Backbone":"7B"}. This record does not assert independent reproduction.

### Gemini 3

Pancreatic Sensitivity (\<=2cm): 96.67. Result ID: 6a3b86d9fbc373592c4390d6.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78731e209131cea78622.md>)

Recorded evaluation configuration: {"Category":"Commercial VLM Models"}. This record does not assert independent reproduction.

### Lingshu-7B

Pancreatic Sensitivity (\<=2cm): 78.79. Result ID: 6a3b86d9fbc373592c4390d8.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa795a1e209131cea7d387.md>)

Recorded evaluation configuration: {"Category":"2D Medical VLM Models","Backbone":"7B"}. This record does not assert independent reproduction.

### SFT+E-MRL

Pancreatic Sensitivity (\<=2cm): 78.79. Result ID: 6a3b86d9fbc373592c4390e3.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B","Training Stage":"Evidence-MRL"}. This record does not assert independent reproduction.

### SFT+GRPO (w/ re, rf)

Pancreatic Sensitivity (\<=2cm): 75.76. Result ID: 6a3b86d9fbc373592c4390e2.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B","Training Stage":"SFT+GRPO","Reward":"re, rf"}. This record does not assert independent reproduction.

### CT-Chat

Pancreatic Sensitivity (\<=2cm): 66.7. Result ID: 6a3b86d9fbc373592c4390da.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bc81e209131cea8a6dc.md>)

Recorded evaluation configuration: {"Category":"3D Medical VLM Models","Training":"SFT"}. This record does not assert independent reproduction.

### RadGPT

Pancreatic Sensitivity (\<=2cm): 66.7. Result ID: 6a3b86d9fbc373592c4390de.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7abb1e209131cea84dc1.md>)

Recorded evaluation configuration: {"Category":"Previous SOTA","Task":"Segmentation-assisted Report Generation"}. This record does not assert independent reproduction.

### SFT

Pancreatic Sensitivity (\<=2cm): 66.67. Result ID: 6a3b86d9fbc373592c4390e0.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B","Training Stage":"SFT"}. This record does not assert independent reproduction.

### SFT+GRPO (w/ re)

Pancreatic Sensitivity (\<=2cm): 60.61. Result ID: 6a3b86d9fbc373592c4390e1.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B","Training Stage":"SFT+GRPO","Reward":"re"}. This record does not assert independent reproduction.

### GPT-4o-mini

Pancreatic Sensitivity (\<=2cm): 57.58. Result ID: 6a3b86d9fbc373592c4390d5.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75681e209131cea67a98.md>)

Recorded evaluation configuration: {"Category":"Commercial VLM Models"}. This record does not assert independent reproduction.

### MedVLM-R1-2B

Pancreatic Sensitivity (\<=2cm): 46.88. Result ID: 6a3b86d9fbc373592c4390d9.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77831e209131cea73bcd.md>)

Recorded evaluation configuration: {"Category":"2D Medical VLM Models","Backbone":"2B"}. This record does not assert independent reproduction.

### Merlin

Pancreatic Sensitivity (\<=2cm): 33.3. Result ID: 6a3b86d9fbc373592c4390dc.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

Recorded evaluation configuration: {"Category":"3D Medical VLM Models","Training":"SFT"}. This record does not assert independent reproduction.

### M3D

Pancreatic Sensitivity (\<=2cm): 8.18. Result ID: 6a3b86d9fbc373592c4390dd.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72be1e209131cea58507.md>)

Recorded evaluation configuration: {"Category":"3D Medical VLM Models","Training":"SFT"}. This record does not assert independent reproduction.

### Zero-shot Inference

Pancreatic Sensitivity (\<=2cm): 6.06. Result ID: 6a3b86d9fbc373592c4390df.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-8B","Training Stage":"Zero-shot"}. This record does not assert independent reproduction.

### CT2Rep

Pancreatic Sensitivity (\<=2cm): 0. Result ID: 6a3b86d9fbc373592c4390db.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b3206542251d7c97e9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74061e209131cea5f4e6.md>)

[Implementation](<https://github.com/ibrahimethemhamamci/CT2Rep>)

Recorded evaluation configuration: {"Category":"3D Medical VLM Models","Training":"SFT"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
