Object Detection Reliability Estimation on COCO in-distribution
0.7Pearson Correlation CoefficientContrastiveConf
Evaluation Results
| Method | Links | |
|---|---|---|
| ContrastiveConfModel Architecture=UP-DETR, Post-processing=Optimal2024.12 | 0.7 | |
| ContrastiveConfModel Architecture=Cal-DETR, Post-processing=Optimal2024.12 | 0.684 | |
| Conf+Model Architecture=Cal-DETR, Post-processing=Optimal2024.12 | 0.67 | |
| ContrastiveConfModel Architecture=DINO, Post-processing=Optimal2024.12 | 0.662 | |
| ContrastiveConfModel Architecture=UP-DETR, Post-processing=OCE2024.12 | 0.656 | |
| ContrastiveConfModel Architecture=D-DETR, Post-processing=Optimal2024.12 | 0.648 | |
| Conf+Model Architecture=DINO, Post-processing=Optimal2024.12 | 0.635 | |
| ContrastiveConfModel Architecture=Cal-DETR, Post-processing=OCE2024.12 | 0.628 | |
| Conf+Model Architecture=D-DETR, Post-processing=Optimal2024.12 | 0.618 | |
| ContrastiveConfModel Architecture=DINO, Post-processing=OCE2024.12 | 0.613 | |
| ContrastiveConfModel Architecture=D-DETR, Post-processing=OCE2024.12 | 0.588 | |
| Conf+Model Architecture=Cal-DETR, Post-processing=OCE2024.12 | 0.547 | |
| Conf+Model Architecture=Cal-DETR, Post-processing=0.32024.12 | 0.539 | |
| Conf+Model Architecture=DINO, Post-processing=OCE2024.12 | 0.512 | |
| Conf+Model Architecture=DINO, Post-processing=0.32024.12 | 0.504 | |
| Conf+Model Architecture=UP-DETR, Post-processing=Optimal2024.12 | 0.503 | |
| Conf+Model Architecture=D-DETR, Post-processing=OCE2024.12 | 0.478 | |
| Conf+Model Architecture=UP-DETR, Post-processing=OCE2024.12 | 0.477 | |
| Conf+Model Architecture=UP-DETR, Post-processing=0.32024.12 | 0.476 | |
| Conf+Model Architecture=D-DETR, Post-processing=0.32024.12 | 0.464 | |
| Conf-Model Architecture=Cal-DETR, Post-processing=OCE2024.12 | -0.571 | |
| Conf-Model Architecture=Cal-DETR, Post-processing=Optimal2024.12 | -0.572 | |
| Conf-Model Architecture=D-DETR, Post-processing=OCE2024.12 | -0.575 | |
| Conf+Model Architecture=Cal-DETR, Post-processing=Top-1002024.12 | -0.581 | |
| Conf-Model Architecture=D-DETR, Post-processing=Optimal2024.12 | -0.584 | |
| Conf-Model Architecture=DINO, Post-processing=OCE2024.12 | -0.585 | |
| Conf-Model Architecture=DINO, Post-processing=Optimal2024.12 | -0.586 | |
| Conf+Model Architecture=DINO, Post-processing=Top-1002024.12 | -0.601 | |
| Conf+Model Architecture=D-DETR, Post-processing=Top-1002024.12 | -0.603 | |
| Conf-Model Architecture=UP-DETR, Post-processing=Optimal2024.12 | -0.608 | |
| Conf+Model Architecture=UP-DETR, Post-processing=Top-1002024.12 | -0.619 | |
| Conf-Model Architecture=UP-DETR, Post-processing=OCE2024.12 | -0.64 |