Data Leakage Detection on APPS
81.91AccuracySrDetection
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SrDetectionBase Model=Qwen2.5-7B, Training Epochs=52026.06 | 81.91 | 81.89 | 82.27 | 81.85 | |
| SrDetectionBase Model=LLaMA3.1-8B, Training Epochs=52026.06 | 78.6 | 79.02 | 78.58 | 78.51 | |
| SrDetectionBase Model=Qwen2.5-7B, Training Epochs=32026.06 | 66.24 | 66.28 | 66.78 | 66 | |
| SrDetectionBase Model=LLaMA3.1-8B, Training Epochs=32026.06 | 63.06 | 63.45 | 63.09 | 62.82 | |
| SrDetectionBase Model=Qwen2.5-7B, Training Epochs=12026.06 | 54.64 | 54.73 | 55.51 | 53.02 | |
| VeilProbeBase Model=Qwen2.5-7B, Training Epochs=52026.06 | 51.75 | 51.83 | 51.69 | 50.78 | |
| VeilProbeBase Model=LLaMA3.1-8B, Training Epochs=52026.06 | 51.61 | 51.64 | 51.63 | 51.53 | |
| SrDetectionBase Model=LLaMA3.1-8B, Training Epochs=12026.06 | 51.59 | 52 | 51.68 | 49.58 | |
| VeilProbeBase Model=LLaMA3.1-8B, Training Epochs=12026.06 | 51.56 | 51.6 | 51.58 | 51.48 | |
| VeilProbeBase Model=LLaMA3.1-8B, Training Epochs=32026.06 | 51.27 | 51.28 | 51.28 | 51.25 | |
| VeilProbeBase Model=Qwen2.5-7B, Training Epochs=12026.06 | 51.04 | 51.1 | 50.96 | 49.33 | |
| VeilProbeBase Model=Qwen2.5-7B, Training Epochs=32026.06 | 50.95 | 50.93 | 50.91 | 50.68 | |
| DPDLLMBase Model=LLaMA3.1-8B, Training Epochs=32026.06 | 50.34 | 50.28 | 99.95 | 33.88 | |
| DPDLLMBase Model=Qwen2.5-7B, Training Epochs=32026.06 | 50.28 | 50.26 | 98.68 | 34.84 | |
| DPDLLMBase Model=LLaMA3.1-8B, Training Epochs=12026.06 | 50.23 | 50.23 | 100 | 33.59 | |
| DPDLLMBase Model=Qwen2.5-7B, Training Epochs=12026.06 | 49.62 | 49.42 | 11.97 | 41.22 | |
| DPDLLMBase Model=LLaMA3.1-8B, Training Epochs=52026.06 | 49.07 | 49.64 | 95.35 | 34.99 | |
| DPDLLMBase Model=Qwen2.5-7B, Training Epochs=52026.06 | 46.21 | 47.72 | 73.89 | 41.7 |