# Classification on vehicle (ROC-AUC)

Source: [Classification on vehicle (ROC-AUC)](<https://www.sota2.com/research/sota/classification-on-vehicle-roc-auc>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-31T08:47:03.209Z

Evaluation of Classification performance on the vehicle dataset, reporting ROC-AUC.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Classification |
| Dataset (including any stated split) | vehicle |
| Metric | ROC AUC |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [ROC AUC](<https://www.sota2.com/research/sota/classification-on-vehicle-roc-auc.md?metric=ROC%20AUC>): Higher is better; unit: PERCENT.

## Recorded results

| Method | ROC AUC | Result date | Report paper |
| --- | --- | --- | --- |
| TabPFN-Proxy-Hybrid | 100 | Not recorded | 69cb54ff0636e5bf4afc9e90 |
| TabPFN-Margin | 100 | Not recorded | 69cb54ff0636e5bf4afc9e90 |
| TabPFN-Hybrid | 99.9 | Not recorded | 69cb54ff0636e5bf4afc9e90 |
| TabPFN-Random | 99.8 | Not recorded | 69cb54ff0636e5bf4afc9e90 |
| TabPFN-Coreset | 99.6 | Not recorded | 69cb54ff0636e5bf4afc9e90 |
| CatBoost-Margin | 99.5 | Not recorded | 69cb54ff0636e5bf4afc9e90 |
| XGBoost-Margin | 98.6 | Not recorded | 69cb54ff0636e5bf4afc9e90 |
| LabelSpreading-Random | 97.5 | Not recorded | 69cb54ff0636e5bf4afc9e90 |
| OpenFE | 95.2 | Not recorded | 6997eac509c33900fcd767ee |
| AutoFeat | 95.1 | Not recorded | 6997eac509c33900fcd767ee |
| CAAFE | 93 | Not recorded | 6997eac509c33900fcd767ee |
| Baseline | 92.9 | Not recorded | 6997eac509c33900fcd767ee |
| FAMOSE | 91.8 | Not recorded | 6997eac509c33900fcd767ee |
| FeatLLM | 79.2 | Not recorded | 6997eac509c33900fcd767ee |

### TabPFN-Proxy-Hybrid

ROC AUC: 100. Result ID: 69cb89f347f34ce924b3e76a.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54ff0636e5bf4afc9e90.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cb54ff0636e5bf4afc9e90.md>)

Recorded evaluation configuration: {"Active Learning Strategy":"Proxy-Hybrid","Backbone":"TabPFN","Label Budget":"100","Batch Size":"10"}. This record does not assert independent reproduction.

### TabPFN-Margin

ROC AUC: 100. Result ID: 69cb89f347f34ce924b3e76b.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54ff0636e5bf4afc9e90.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cb54ff0636e5bf4afc9e90.md>)

Recorded evaluation configuration: {"Active Learning Strategy":"Margin","Backbone":"TabPFN","Label Budget":"100","Batch Size":"10"}. This record does not assert independent reproduction.

### TabPFN-Hybrid

ROC AUC: 99.9. Result ID: 69cb89f347f34ce924b3e769.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54ff0636e5bf4afc9e90.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cb54ff0636e5bf4afc9e90.md>)

Recorded evaluation configuration: {"Active Learning Strategy":"Hybrid","Backbone":"TabPFN","Label Budget":"100","Batch Size":"10"}. This record does not assert independent reproduction.

### TabPFN-Random

ROC AUC: 99.8. Result ID: 69cb89f347f34ce924b3e76c.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54ff0636e5bf4afc9e90.md>)

Recorded evaluation configuration: {"Active Learning Strategy":"Random","Backbone":"TabPFN","Label Budget":"100","Batch Size":"10"}. This record does not assert independent reproduction.

### TabPFN-Coreset

ROC AUC: 99.6. Result ID: 69cb89f347f34ce924b3e768.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54ff0636e5bf4afc9e90.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cb54ff0636e5bf4afc9e90.md>)

Recorded evaluation configuration: {"Active Learning Strategy":"Coreset","Backbone":"TabPFN","Label Budget":"100","Batch Size":"10"}. This record does not assert independent reproduction.

### CatBoost-Margin

ROC AUC: 99.5. Result ID: 69cb89f347f34ce924b3e76d.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54ff0636e5bf4afc9e90.md>)

Recorded evaluation configuration: {"Active Learning Strategy":"Margin","Backbone":"CatBoost","Label Budget":"100","Batch Size":"10"}. This record does not assert independent reproduction.

### XGBoost-Margin

ROC AUC: 98.6. Result ID: 69cb89f347f34ce924b3e76e.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54ff0636e5bf4afc9e90.md>)

Recorded evaluation configuration: {"Active Learning Strategy":"Margin","Backbone":"XGBoost","Label Budget":"100","Batch Size":"10"}. This record does not assert independent reproduction.

### LabelSpreading-Random

ROC AUC: 97.5. Result ID: 69cb89f347f34ce924b3e76f.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54ff0636e5bf4afc9e90.md>)

Recorded evaluation configuration: {"Active Learning Strategy":"Random","Backbone":"LabelSpreading","Label Budget":"100","Batch Size":"10"}. This record does not assert independent reproduction.

### OpenFE

ROC AUC: 95.2. Result ID: 699b11445698665ec4a4b25d.

[Reporting paper](<https://www.sota2.com/research/paper/6997eac509c33900fcd767ee.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f921e209131cea46578.md>)

Recorded evaluation configuration: {"folds":5}. This record does not assert independent reproduction.

### AutoFeat

ROC AUC: 95.1. Result ID: 699b11445698665ec4a4b25e.

[Reporting paper](<https://www.sota2.com/research/paper/6997eac509c33900fcd767ee.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67191e209131cea1428f.md>)

Recorded evaluation configuration: {"folds":5}. This record does not assert independent reproduction.

### CAAFE

ROC AUC: 93. Result ID: 699b11445698665ec4a4b260.

[Reporting paper](<https://www.sota2.com/research/paper/6997eac509c33900fcd767ee.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70ba1e209131cea4ce0e.md>)

Recorded evaluation configuration: {"folds":5}. This record does not assert independent reproduction.

### Baseline

ROC AUC: 92.9. Result ID: 699b11445698665ec4a4b25c.

[Reporting paper](<https://www.sota2.com/research/paper/6997eac509c33900fcd767ee.md>)

Recorded evaluation configuration: {"folds":5}. This record does not assert independent reproduction.

### FAMOSE

ROC AUC: 91.8. Result ID: 699b11445698665ec4a4b261.

[Reporting paper](<https://www.sota2.com/research/paper/6997eac509c33900fcd767ee.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6997eac509c33900fcd767ee.md>)

Recorded evaluation configuration: {"folds":5}. This record does not assert independent reproduction.

### FeatLLM

ROC AUC: 79.2. Result ID: 699b11445698665ec4a4b25f.

[Reporting paper](<https://www.sota2.com/research/paper/6997eac509c33900fcd767ee.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73131e209131cea5a4a9.md>)

Recorded evaluation configuration: {"folds":5}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
