Function Completion on RepoEval (All)
42.63Pass RateOracle
Evaluation results
| Method | Links | |
|---|---|---|
| OracleBackbone=GPT-3.5-Turbo, Retrieval Mode=Oracle2023.03 | 42.63 | |
| RepoCoderBackbone=GPT-3.5-Turbo, Iterations=22023.03 | 42.63 | |
| RepoCoderBackbone=GPT-3.5-Turbo, Iterations=42023.03 | 42.36 | |
| RepoCoderBackbone=GPT-3.5-Turbo, Iterations=32023.03 | 41.82 | |
| RepoCoderBackbone=GPT-3.5-Turbo, Iterations=12023.03 | 38.34 | |
| In-FileBackbone=GPT-3.5-Turbo, Retrieval Mode=In-File2023.03 | 23.32 |