List your company

ResearchFormerly WizWand

CodeNet

Benchmarks

TaskDatasetSOTA resultTrendResults

Source Code Watermark Extraction Robustness

CodeNet D152 (evaluation)

100Accuracy

36

Source Code Watermark Extraction Robustness

CodeNet D88 (evaluation)

100Accuracy

36

Source Code Watermark Extraction Robustness

CodeNet D56 (evaluation)

100Accuracy

36

Source Code Watermark Extraction Robustness

CodeNet D40 (evaluation)

100Accuracy

36

Source Code Watermark Extraction Robustness

CodeNet D32 (evaluation)

100Accuracy

36

Code runtime regression

CodeNet (test)

240.8Overall MAE

18

Code Translation

CodeNet

93.6Computational Accuracy (C)

11

Spurious Regression

CodeNet

2.28Average Metric Rank

9

Code classification

CodeNet Python800 (test)

0.013Error Rate

7

Code classification

CodeNet Java250 (test)

1.56Error Rate

7

Clone Detection

CodeNet Python800 1.0 (test)

86.01MAP@R

6

Clone Detection

CodeNet Java250 1.0 (test)

86.74MAP@R

6

Code classification

CodeNet C++1000 (test)

6.18Error Rate

4

Clone Detection

CodeNet C++1000 1.0 (test)

60.21MAP@R

4

Code-to-code Search

CodeNet

79.13MAP

4

Code Watermarking Robustness

CodeNet D32 n=250

100Extraction Rate (No Attack)

3