Distractor Generation on CLOTH
73.25Hardest AccuracyDCDG + ASDE, DDDE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DCDG + ASDE, DDDEType=Hard2025.11 | 73.25 | 19.24 | 7.31 | |
| DCDG + ASDEType=Hard2025.11 | 72.14 | 19.74 | 7.62 | |
| DCDGType=Hard2025.11 | 70.35 | 20 | 9.15 | |
| DCDG + DDDEType=Hard2025.11 | 67.97 | 23.39 | 8.73 | |
| GPT-4o (0-shot)Type=Hard2025.11 | 56.77 | 28.08 | 15.15 | |
| GPT-4o (5-shot)Type=Hard2025.11 | 53.81 | 30.56 | 15.83 | |
| GPT-4o (0-shot)Type=Easy2025.11 | 29.6 | 36.36 | 33.54 | |
| GPT-4o (5-shot)Type=Original2025.11 | 24.35 | 38.38 | 37.78 | |
| DCDG + DDDEType=Original2025.11 | 22.69 | 43.98 | 33.73 | |
| GPT-4o (5-shot)Type=Easy2025.11 | 21.84 | 31.06 | 46.39 | |
| DCDGType=Original2025.11 | 20.4 | 47.94 | 32.36 | |
| DCDG + ASDE, DDDEType=Original2025.11 | 20.04 | 51.8 | 28.46 | |
| DCDG + ASDEType=Original2025.11 | 19.64 | 49.7 | 31.66 | |
| GPT-4o (0-shot)Type=Original2025.11 | 13.64 | 35.56 | 51.31 | |
| DCDG + DDDEType=Easy2025.11 | 9.34 | 32.63 | 57.53 | |
| DCDGType=Easy2025.11 | 9.25 | 32.06 | 58.49 | |
| DCDG + ASDEType=Easy2025.11 | 8.22 | 30.56 | 60.72 | |
| DCDG + ASDE, DDDEType=Easy2025.11 | 6.71 | 28.96 | 64.23 |