List your company

Section Identification on MedSecId Corpus

96.86AccuracyGPT-4
1.575226.312651.0575.7874Apr 25, 2024

Evaluation results

MethodLinks
GPT-4Prompting Strategy=One Shot Prompt2024.0496.8610092.9396.2496.11
GPT-4Prompting Strategy=Chain-of-Thought (COT)2024.0494.910088.6293.9792.47
GPT-4Prompting Strategy=Zero Shot Prompt2024.0494.4110087.6193.492.05
BILSTM-CRF2024.0482.2959595—
GPT-4Prompting Strategy=Close Ended Prompt2024.0473.2310073.2384.5573.2
MedSpacy2024.0456.6310038.2955.3862.63
LLaMa-2Prompting Strategy=Zero Shot Prompt2024.0452.2994.6132.9248.8262.25
Regex2024.0449.2410030.0746.2450.8
LLaMa-2Prompting Strategy=Close Ended Prompt2024.0439.9610039.9657.139.94
LLaMa-2Prompting Strategy=Chain-of-Thought (CoT)2024.0438.2193.9521.1134.4846.95
Keyword Based2024.0436.0710036.0753.0136.05
LLaMa-2Prompting Strategy=One Shot Prompt2024.0413.9594.576.8612.816.86
MistralPrompting Strategy=Chain-of-Thought (CoT)2024.0411.9998.615.6410.6715.53
MistralPrompting Strategy=Zero Shot Prompt2024.0411.5197.435.239.9314.45
MistralPrompting Strategy=One Shot Prompt2024.048.4198.614.077.8210.48
MistralPrompting Strategy=Close Ended Prompt2024.045.241005.249.965.24