# Section Identification on i2b2 Corpus 2010

Source: [Section Identification on i2b2 Corpus 2010](<https://www.sota2.com/research/sota/section-identification-on-i2b2-corpus-2010>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:29:37.684Z

Evaluation of Section Identification performance on the i2b2 Corpus 2010 dataset.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Section Identification |
| Dataset (including any stated split) | i2b2 Corpus 2010 |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/section-identification-on-i2b2-corpus-2010.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [Precision](<https://www.sota2.com/research/sota/section-identification-on-i2b2-corpus-2010.md?metric=Precision>): Higher is better; unit: PERCENT.

- [Recall](<https://www.sota2.com/research/sota/section-identification-on-i2b2-corpus-2010.md?metric=Recall>): Higher is better; unit: PERCENT.

- [F1 Score](<https://www.sota2.com/research/sota/section-identification-on-i2b2-corpus-2010.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

- [Exact Match](<https://www.sota2.com/research/sota/section-identification-on-i2b2-corpus-2010.md?metric=Exact%20Match>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| GPT-4 | 93.03 | Not recorded | 68fa72f91e209131cea59aca |
| Maximum Entropy | 91.1 | Not recorded | 68fa72f91e209131cea59aca |
| GPT-4 | 89.47 | Not recorded | 68fa72f91e209131cea59aca |
| LLaMa-2 | 88.79 | Not recorded | 68fa72f91e209131cea59aca |
| GPT-4 | 86.26 | Not recorded | 68fa72f91e209131cea59aca |
| Regex | 66.26 | Not recorded | 68fa72f91e209131cea59aca |
| LLaMa-2 | 56.2 | Not recorded | 68fa72f91e209131cea59aca |
| LLaMa-2 | 40.23 | Not recorded | 68fa72f91e209131cea59aca |
| MedSpacy | 38.45 | Not recorded | 68fa72f91e209131cea59aca |
| Mistral | 35.3 | Not recorded | 68fa72f91e209131cea59aca |
| Mistral | 32.13 | Not recorded | 68fa72f91e209131cea59aca |
| LLaMa-2 | 30.54 | Not recorded | 68fa72f91e209131cea59aca |
| GPT-4 | 11.82 | Not recorded | 68fa72f91e209131cea59aca |
| Keyword Based | 10.98 | Not recorded | 68fa72f91e209131cea59aca |
| Mistral | 10.41 | Not recorded | 68fa72f91e209131cea59aca |
| Mistral | 6.58 | Not recorded | 68fa72f91e209131cea59aca |

### GPT-4

Accuracy: 93.03. Result ID: 6992a6043a6c314849106376.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Implementation](<https://github.com/inQbator-eviCore/LLM_section_identifiers>)

Recorded evaluation configuration: {"Prompting strategy":"One Shot"}. This record does not assert independent reproduction.

### Maximum Entropy

Accuracy: 91.1. Result ID: 6992a6043a6c31484910637f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GPT-4

Accuracy: 89.47. Result ID: 6992a6043a6c314849106375.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Implementation](<https://github.com/inQbator-eviCore/LLM_section_identifiers>)

Recorded evaluation configuration: {"Prompting strategy":"Zero Shot"}. This record does not assert independent reproduction.

### LLaMa-2

Accuracy: 88.79. Result ID: 6992a6043a6c314849106377.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Implementation](<https://github.com/inQbator-eviCore/LLM_section_identifiers>)

Recorded evaluation configuration: {"Prompting strategy":"Close Ended"}. This record does not assert independent reproduction.

### GPT-4

Accuracy: 86.26. Result ID: 6992a6043a6c314849106374.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Implementation](<https://github.com/inQbator-eviCore/LLM_section_identifiers>)

Recorded evaluation configuration: {"Prompting strategy":"Chain-of-Thought (COT)"}. This record does not assert independent reproduction.

### Regex

Accuracy: 66.26. Result ID: 6992a6043a6c314849106371.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LLaMa-2

Accuracy: 56.2. Result ID: 6992a6043a6c314849106378.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Implementation](<https://github.com/inQbator-eviCore/LLM_section_identifiers>)

Recorded evaluation configuration: {"Prompting strategy":"Zero Shot"}. This record does not assert independent reproduction.

### LLaMa-2

Accuracy: 40.23. Result ID: 6992a6043a6c31484910637a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Implementation](<https://github.com/inQbator-eviCore/LLM_section_identifiers>)

Recorded evaluation configuration: {"Prompting strategy":"Chain-of-Thought (CoT)"}. This record does not assert independent reproduction.

### MedSpacy

Accuracy: 38.45. Result ID: 6992a6043a6c314849106372.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a2c1e209131cea26947.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Mistral

Accuracy: 35.3. Result ID: 6992a6043a6c31484910637c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Implementation](<https://github.com/inQbator-eviCore/LLM_section_identifiers>)

Recorded evaluation configuration: {"Prompting strategy":"Zero Shot"}. This record does not assert independent reproduction.

### Mistral

Accuracy: 32.13. Result ID: 6992a6043a6c31484910637e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Implementation](<https://github.com/inQbator-eviCore/LLM_section_identifiers>)

Recorded evaluation configuration: {"Prompting strategy":"Chain-of-Thought (CoT)"}. This record does not assert independent reproduction.

### LLaMa-2

Accuracy: 30.54. Result ID: 6992a6043a6c314849106379.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Implementation](<https://github.com/inQbator-eviCore/LLM_section_identifiers>)

Recorded evaluation configuration: {"Prompting strategy":"One Shot"}. This record does not assert independent reproduction.

### GPT-4

Accuracy: 11.82. Result ID: 6992a6043a6c314849106373.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Implementation](<https://github.com/inQbator-eviCore/LLM_section_identifiers>)

Recorded evaluation configuration: {"Prompting strategy":"Close Ended"}. This record does not assert independent reproduction.

### Keyword Based

Accuracy: 10.98. Result ID: 6992a6043a6c314849106370.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Mistral

Accuracy: 10.41. Result ID: 6992a6043a6c31484910637b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Implementation](<https://github.com/inQbator-eviCore/LLM_section_identifiers>)

Recorded evaluation configuration: {"Prompting strategy":"Close Ended"}. This record does not assert independent reproduction.

### Mistral

Accuracy: 6.58. Result ID: 6992a6043a6c31484910637d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f91e209131cea59aca.md>)

[Implementation](<https://github.com/inQbator-eviCore/LLM_section_identifiers>)

Recorded evaluation configuration: {"Prompting strategy":"One Shot"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
