List your company

Section Identification on i2b2 Corpus 2010

93.03AccuracyGPT-4
3.12226.463549.80573.1465Apr 25, 2024

Evaluation results

MethodLinks
GPT-4Prompting strategy=One Shot2024.0493.0310085.3692.189.45
Maximum Entropy2024.0491.1—90.891—
GPT-4Prompting strategy=Zero Shot2024.0489.4710078.4687.9384.58
LLaMa-2Prompting strategy=Close Ended2024.0488.7910083.5791.0586.54
GPT-4Prompting strategy=Chain-of-Thought (COT)2024.0486.2699.8574.6585.4384.33
Regex2024.0466.2610048.2765.1156.8
LLaMa-2Prompting strategy=Zero Shot2024.0456.210036.6253.6158.59
LLaMa-2Prompting strategy=Chain-of-Thought (CoT)2024.0440.2399.8322.6136.8750.7
MedSpacy2024.0438.4510021.9235.9638.14
MistralPrompting strategy=Zero Shot2024.0435.310018.9831.936.17
MistralPrompting strategy=Chain-of-Thought (CoT)2024.0432.1399.817.0329.0933.66
LLaMa-2Prompting strategy=One Shot2024.0430.5410016.7528.6921.2
GPT-4Prompting strategy=Close Ended2024.0411.8278.248.4615.2773.8
Keyword Based2024.0410.981008.7816.1469.5
MistralPrompting strategy=Close Ended2024.0410.411006.6512.4819.34
MistralPrompting strategy=One Shot2024.046.581003.246.297.8