Automated Data Preparation on DeepLine dataset collection (test)
91.2Test AccuracyFlowPipe
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FlowPipeSetup=Ours, Inference Time (s)=10.5102026.06 | 91.2 | 1.089 | 81.3 | 82.3 | 80.5 | |
| CtxPipeVenue=SIGMOD'24, Inference Time (s)=14.3102026.06 | 81.3 | 5.611 | 78.4 | 78.7 | 77.5 | |
| SAGAVenue=SIGMOD'23, Inference Time (s)=784.1322026.06 | 80.9 | 4.132 | 71.4 | 73.1 | 72.3 | |
| HAI-AIVenue=SIGMOD'23, Inference Time (s)=16.7802026.06 | 80.1 | 5.189 | 78.1 | 75.3 | 76.7 | |
| TPEVenue=arXiv'23, Inference Time (s)=382.3412026.06 | 79.2 | 5.85 | 70.4 | 71.1 | 70.8 | |
| DP-FlexVenue=SIGMOD'23, Inference Time (s)=2183.9172026.06 | 78.9 | 6.122 | 77.2 | 78.9 | 76.9 | |
| DP-FixVenue=SIGMOD'23, Inference Time (s)=325.6482026.06 | 78 | 7.356 | 76.7 | 78 | 76.4 | |
| SwiftDPVenue=ICDE'25, Inference Time (s)=5.7602026.06 | 78 | 6.845 | 69.2 | 63.6 | 64.3 | |
| ChatPipeVenue=SIGMOD'24, Inference Time (s)=284.4112026.06 | 77.7 | 7.62 | 74.1 | 71.8 | 73 | |
| RSVenue=SIGMOD'23, Inference Time (s)=2069.0282026.06 | 77.6 | 8.328 | 75.5 | 77.6 | 75.1 | |
| DEFVenue=SIGMOD'23, Inference Time (s)=268.8992026.06 | 76 | 8.722 | 75.4 | 76.9 | 75.1 | |
| DLVenue=SIGKDD'20, Inference Time (s)=48.4392026.06 | 74 | 9.921 | 73.8 | 74 | 72.7 | |
| Direct PromptingSetup=Zero-shot Llama-3.1-8B, Inference Time (s)=112.1072026.06 | 72.3 | 11.45 | 61.9 | 61.1 | 61.5 |