List your company
ResearchFormerly WizWand

Research method classification on LIS research method dataset (test)

72.08Micro-F1SciBERT (Sum)
60.088863.201966.31569.4281Jun 17, 2026
Updated 4mo ago

Evaluation results

MethodLinks
SciBERT (Sum)Scheme=C4, Segment Pair=5-62026.0672.0874.0370.22
SciBERTScheme=C4, Segment Pair=6-72026.0671.6679.7365.07
SciBERT-longScheme=TA (Title+Abstract)2026.0671.52——
DeepSeek-LLM-7BScheme=C4, Segment Pair=5-102026.0671.0780.3763.7
SciBERT-longScheme=C4, Segment Pair=4-92026.0670.5770.1870.96
SciBERTScheme=TA (Title+Abstract)2026.0670.34——
SciBERT (Sum)Scheme=TA (Title+Abstract)2026.0670.34——
BERT (Sum)Scheme=C4, Segment Pair=7-82026.0669.7380.6861.4
SciBERT-longScheme=C3, Segment Pair=4-102026.0668.6178.9560.66
Qwen2.5-7BScheme=C4, Segment Pair=6-102026.0668.0677.9960.37
Llama-3-8BScheme=C3, Segment Pair=2-102026.0666.5279.0857.41
Llama-3-8BScheme=C4, Segment Pair=1-42026.0666.5279.0857.41
SciBERT (Sum)Scheme=C3, Segment Pair=6-102026.0666.3975.5959.19
BERTScheme=TA (Title+Abstract)2026.0665.54——
BERT (Sum)Scheme=TA (Title+Abstract)2026.0665.54——
BigbirdScheme=TA (Title+Abstract)2026.0665.51——
DeepSeek-LLM-7BScheme=TA (Title+Abstract)2026.0665.48——
BigbirdScheme=C3, Segment Pair=7-102026.0665.4167.3263.6
BERT (Sum)Scheme=C3, Segment Pair=5-82026.0665.2974.5358.09
DeepSeek-LLM-7BScheme=C3, Segment Pair=3-102026.0664.7274.1657.41
SciBERTScheme=C3, Segment Pair=5-102026.0664.3966.4162.5
BERTScheme=C3, Segment Pair=7-102026.0664.1964.7963.6
BERTScheme=C4, Segment Pair=4-92026.0663.8969.459.19
BigbirdScheme=C4, Segment Pair=6-102026.0663.4167.7859.56
Qwen2.5-7BScheme=C3, Segment Pair=2-102026.0662.6973.8754.44
Llama-3-8BScheme=TA (Title+Abstract)2026.0660.93——
Qwen2.5-7BScheme=TA (Title+Abstract)2026.0660.55——