List your company
ResearchFormerly WizWand

Citation Recommendation on Scientific Paper Domains Natural science (test)

0.736P@3H-LM
-0.003440.188530.38050.57247Oct 10, 2024
Updated 8mo ago

Evaluation results

MethodLinks
H-LMLLM version=GPT-4o, Testing set note=Randomly tested 10% due to API limits2024.100.7360.6550.7430.686
H-LMLLM version=GPT-3.52024.100.7250.6440.7340.677
GTE-large-v1.52024.100.6470.5620.6690.605
GTE-large2024.100.640.5560.6610.597
GTE-base2024.100.6380.5550.6590.596
GTE-base-v1.52024.100.6370.5490.660.593
OpenAI-32024.100.6320.5430.6550.588
OpenAI-ada-0022024.100.6230.5340.6460.579
SPECTER-2.02024.100.60.5120.6250.558
SciMult-MoE2024.100.5780.4930.6010.537
SciNCL2024.100.5750.4950.5980.537
SciMult-vanilla2024.100.5680.4830.5910.527
SPECTER2024.100.5420.4570.5670.502
SciPATTON2024.100.4440.3680.470.41
Keywords overlap2024.100.3340.2670.3020.262
PATTON2024.100.2480.2010.2660.229
METAG2024.100.1120.0890.1240.104
SciBERT2024.100.0530.0460.0560.05
BERT-base2024.100.0360.0340.0360.035
BERT-large2024.100.0250.0270.0240.026