Function Search on MultiComp benchmark leaderboard · SOTA2 Research

Function Search on MultiComp

0.94nDCG@5BinBERT

Evaluation Results

Method	Links
BinBERT2026.02		0.94	0.91	0.9	0.9	0.9	0.91	0.47	0.72	0.82	0.87	0.88	0.89
Trex2026.02		0.93	0.87	0.85	0.84	0.85	0.85	0.46	0.68	0.76	0.79	0.8	0.81
SAFE2026.02		0.92	0.85	0.82	0.81	0.81	0.81	0.45	0.66	0.72	0.74	0.75	0.76
CLAP2026.02		0.92	0.86	0.84	0.84	0.85	0.85	0.45	0.67	0.76	0.8	0.82	0.83
PalmTree2026.02		0.92	0.84	0.81	0.81	0.81	0.81	0.45	0.65	0.72	0.74	0.75	0.75
BinBERT2026.02		0.91	0.86	0.84	0.84	0.85	0.86	0.45	0.67	0.76	0.8	0.83	0.84
jTrans2026.02		0.9	0.8	0.77	0.76	0.76	0.76	0.43	0.59	0.65	0.67	0.68	0.69
CLAP2026.02		0.88	0.81	0.79	0.8	0.8	0.81	0.42	0.62	0.7	0.74	0.77	0.78
Gemini2026.02		0.84	0.71	0.67	0.66	0.66	0.66	0.39	0.51	0.54	0.55	0.56	0.56
Trex2026.02		0.84	0.75	0.73	0.73	0.74	0.75	0.4	0.56	0.63	0.67	0.69	0.71
PalmTree2026.02		0.78	0.65	0.63	0.63	0.64	0.65	0.34	0.45	0.51	0.54	0.57	0.59
SAFE2026.02		0.74	0.62	0.6	0.61	0.62	0.63	0.33	0.43	0.49	0.53	0.56	0.58
jTrans2026.02		0.74	0.63	0.6	0.6	0.61	0.61	0.32	0.43	0.48	0.5	0.53	0.54
Gemini2026.02		0.61	0.49	0.46	0.46	0.47	0.48	0.25	0.31	0.34	0.36	0.38	0.4