Function Search on BinCorp
91nDCG@5jTrans
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| jTransBFS model=jTrans, re-ranker=DEEP, window size (w)=2002026.02 | 91 | 94 | 95 | 95 | 95 | 95 | 88 | 93 | 94 | 95 | 95 | 95 | |
| CLAPBFS model=CLAP, re-ranker=DEEP, window size (w)=2002026.02 | 91 | 94 | 94 | 94 | 94 | 94 | 88 | 92 | 94 | 94 | 94 | 95 | |
| BinBERTBFS model=BinBERT, re-ranker=DEEP, window size (w)=2002026.02 | 88 | 90 | 90 | 91 | 91 | 91 | 84 | 87 | 88 | 88 | 88 | 89 | |
| CLAPBFS model=CLAP, re-ranker=None, window size (w)=2002026.02 | 87 | 89 | 90 | 91 | 91 | 91 | 83 | 87 | 89 | 90 | 91 | 91 | |
| TrexBFS model=Trex, re-ranker=DEEP, window size (w)=2002026.02 | 81 | 82 | 82 | 82 | 82 | 82 | 74 | 76 | 76 | 77 | 77 | 77 | |
| SAFEBFS model=SAFE, re-ranker=DEEP, window size (w)=2002026.02 | 77 | 78 | 78 | 78 | 78 | 78 | 69 | 71 | 71 | 71 | 72 | 72 | |
| PalmTreeBFS model=PalmTree, re-ranker=DEEP, window size (w)=2002026.02 | 76 | 76 | 77 | 77 | 77 | 77 | 68 | 69 | 69 | 70 | 70 | 70 | |
| jTransBFS model=jTrans, re-ranker=None, window size (w)=2002026.02 | 75 | 80 | 82 | 83 | 84 | 84 | 68 | 77 | 81 | 83 | 85 | 86 | |
| BinBERTBFS model=BinBERT, re-ranker=None, window size (w)=2002026.02 | 74 | 78 | 79 | 80 | 80 | 81 | 66 | 73 | 76 | 78 | 79 | 80 | |
| TrexBFS model=Trex, re-ranker=None, window size (w)=2002026.02 | 61 | 65 | 66 | 67 | 67 | 68 | 50 | 56 | 60 | 62 | 63 | 65 | |
| PalmTreeBFS model=PalmTree, re-ranker=None, window size (w)=2002026.02 | 59 | 61 | 62 | 63 | 63 | 64 | 48 | 52 | 54 | 56 | 57 | 58 | |
| GeminiBFS model=Gemini, re-ranker=DEEP, window size (w)=2002026.02 | 57 | 57 | 57 | 57 | 57 | 57 | 45 | 45 | 46 | 46 | 46 | 46 | |
| SAFEBFS model=SAFE, re-ranker=None, window size (w)=2002026.02 | 54 | 57 | 58 | 59 | 60 | 61 | 42 | 48 | 51 | 53 | 55 | 57 | |
| GeminiBFS model=Gemini, re-ranker=None, window size (w)=2002026.02 | 40 | 41 | 42 | 42 | 43 | 43 | 27 | 30 | 31 | 32 | 33 | 34 |