Research method classification on LIS research method dataset (test)
72.08Micro-F1SciBERT (Sum)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SciBERT (Sum)Scheme=C4, Segment Pair=5-62026.06 | 72.08 | 74.03 | 70.22 | |
| SciBERTScheme=C4, Segment Pair=6-72026.06 | 71.66 | 79.73 | 65.07 | |
| SciBERT-longScheme=TA (Title+Abstract)2026.06 | 71.52 | — | — | |
| DeepSeek-LLM-7BScheme=C4, Segment Pair=5-102026.06 | 71.07 | 80.37 | 63.7 | |
| SciBERT-longScheme=C4, Segment Pair=4-92026.06 | 70.57 | 70.18 | 70.96 | |
| SciBERTScheme=TA (Title+Abstract)2026.06 | 70.34 | — | — | |
| SciBERT (Sum)Scheme=TA (Title+Abstract)2026.06 | 70.34 | — | — | |
| BERT (Sum)Scheme=C4, Segment Pair=7-82026.06 | 69.73 | 80.68 | 61.4 | |
| SciBERT-longScheme=C3, Segment Pair=4-102026.06 | 68.61 | 78.95 | 60.66 | |
| Qwen2.5-7BScheme=C4, Segment Pair=6-102026.06 | 68.06 | 77.99 | 60.37 | |
| Llama-3-8BScheme=C3, Segment Pair=2-102026.06 | 66.52 | 79.08 | 57.41 | |
| Llama-3-8BScheme=C4, Segment Pair=1-42026.06 | 66.52 | 79.08 | 57.41 | |
| SciBERT (Sum)Scheme=C3, Segment Pair=6-102026.06 | 66.39 | 75.59 | 59.19 | |
| BERTScheme=TA (Title+Abstract)2026.06 | 65.54 | — | — | |
| BERT (Sum)Scheme=TA (Title+Abstract)2026.06 | 65.54 | — | — | |
| BigbirdScheme=TA (Title+Abstract)2026.06 | 65.51 | — | — | |
| DeepSeek-LLM-7BScheme=TA (Title+Abstract)2026.06 | 65.48 | — | — | |
| BigbirdScheme=C3, Segment Pair=7-102026.06 | 65.41 | 67.32 | 63.6 | |
| BERT (Sum)Scheme=C3, Segment Pair=5-82026.06 | 65.29 | 74.53 | 58.09 | |
| DeepSeek-LLM-7BScheme=C3, Segment Pair=3-102026.06 | 64.72 | 74.16 | 57.41 | |
| SciBERTScheme=C3, Segment Pair=5-102026.06 | 64.39 | 66.41 | 62.5 | |
| BERTScheme=C3, Segment Pair=7-102026.06 | 64.19 | 64.79 | 63.6 | |
| BERTScheme=C4, Segment Pair=4-92026.06 | 63.89 | 69.4 | 59.19 | |
| BigbirdScheme=C4, Segment Pair=6-102026.06 | 63.41 | 67.78 | 59.56 | |
| Qwen2.5-7BScheme=C3, Segment Pair=2-102026.06 | 62.69 | 73.87 | 54.44 | |
| Llama-3-8BScheme=TA (Title+Abstract)2026.06 | 60.93 | — | — | |
| Qwen2.5-7BScheme=TA (Title+Abstract)2026.06 | 60.55 | — | — |