# Code Search on Code Search (test) Source: [Code Search on Code Search (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:46:57.135Z Evaluation of the Code Search task performance on the test split of the Code Search dataset, reporting retrieval metrics including IT, OT, TT, and Precision. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Code Search | | Dataset (including any stated split) | Code Search (test) | | Metric | IT | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [IT](): Higher is better; unit: SCALAR. - [R-IT](): Higher is better; unit: SCALAR. - [OT](): Higher is better; unit: SCALAR. - [R-OT](): Higher is better; unit: SCALAR. - [TT](): Higher is better; unit: SCALAR. - [R-TT](): Higher is better; unit: SCALAR. - [Precision](): Higher is better; unit: PERCENT. - [R-P](): Higher is better; unit: PERCENT. ## Recorded results | Method | IT | Result date | Report paper | | --- | --- | --- | --- | | Base | 102385 | Not recorded | 68fa793e1e209131cea7cd46 | | DietCode | 98105 | Not recorded | 68fa793e1e209131cea7cd46 | | LeanCode | 96978 | Not recorded | 68fa793e1e209131cea7cd46 | | SlimCode | 96845 | Not recorded | 68fa793e1e209131cea7cd46 | | DietCode | 93268 | Not recorded | 68fa793e1e209131cea7cd46 | | SlimCode | 91736 | Not recorded | 68fa793e1e209131cea7cd46 | | LeanCode | 91173 | Not recorded | 68fa793e1e209131cea7cd46 | | DietCode | 86672 | Not recorded | 68fa793e1e209131cea7cd46 | | SlimCode | 85778 | Not recorded | 68fa793e1e209131cea7cd46 | | LeanCode | 85202 | Not recorded | 68fa793e1e209131cea7cd46 | | DietCode | 80196 | Not recorded | 68fa793e1e209131cea7cd46 | | SlimCode | 79686 | Not recorded | 68fa793e1e209131cea7cd46 | | LeanCode | 79102 | Not recorded | 68fa793e1e209131cea7cd46 | | DietCode | 73759 | Not recorded | 68fa793e1e209131cea7cd46 | | SlimCode | 73215 | Not recorded | 68fa793e1e209131cea7cd46 | | LeanCode | 72887 | Not recorded | 68fa793e1e209131cea7cd46 | ### Base IT: 102385. Result ID: 6995d5af3badfaffe6db603f. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-4"}. This record does not assert independent reproduction. ### DietCode IT: 98105. Result ID: 6995d5af3badfaffe6db6040. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4","Removal Ratio":"10%"}. This record does not assert independent reproduction. ### LeanCode IT: 96978. Result ID: 6995d5af3badfaffe6db604a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4","Removal Ratio":"10%"}. This record does not assert independent reproduction. ### SlimCode IT: 96845. Result ID: 6995d5af3badfaffe6db6045. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4","Removal Ratio":"10%"}. This record does not assert independent reproduction. ### DietCode IT: 93268. Result ID: 6995d5af3badfaffe6db6041. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4","Removal Ratio":"20%"}. This record does not assert independent reproduction. ### SlimCode IT: 91736. Result ID: 6995d5af3badfaffe6db6046. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4","Removal Ratio":"20%"}. This record does not assert independent reproduction. ### LeanCode IT: 91173. Result ID: 6995d5af3badfaffe6db604b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4","Removal Ratio":"20%"}. This record does not assert independent reproduction. ### DietCode IT: 86672. Result ID: 6995d5af3badfaffe6db6042. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4","Removal Ratio":"30%"}. This record does not assert independent reproduction. ### SlimCode IT: 85778. Result ID: 6995d5af3badfaffe6db6047. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4","Removal Ratio":"30%"}. This record does not assert independent reproduction. ### LeanCode IT: 85202. Result ID: 6995d5af3badfaffe6db604c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4","Removal Ratio":"30%"}. This record does not assert independent reproduction. ### DietCode IT: 80196. Result ID: 6995d5af3badfaffe6db6043. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4","Removal Ratio":"40%"}. This record does not assert independent reproduction. ### SlimCode IT: 79686. Result ID: 6995d5af3badfaffe6db6048. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4","Removal Ratio":"40%"}. This record does not assert independent reproduction. ### LeanCode IT: 79102. Result ID: 6995d5af3badfaffe6db604d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4","Removal Ratio":"40%"}. This record does not assert independent reproduction. ### DietCode IT: 73759. Result ID: 6995d5af3badfaffe6db6044. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4","Removal Ratio":"50%"}. This record does not assert independent reproduction. ### SlimCode IT: 73215. Result ID: 6995d5af3badfaffe6db6049. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4","Removal Ratio":"50%"}. This record does not assert independent reproduction. ### LeanCode IT: 72887. Result ID: 6995d5af3badfaffe6db604e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4","Removal Ratio":"50%"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.