# Lexicon Induction on Manually validated lexicon induction 1803 words (test)

Source: [Lexicon Induction on Manually validated lexicon induction 1803 words (test)](<https://www.sota2.com/research/sota/lexicon-induction-on-manually-validated-lexicon-induction-1803-words-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:22:53.645Z

Evaluation of Lexicon Induction performance using the manually validated 1803-word test set.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Lexicon Induction |
| Dataset (including any stated split) | Manually validated lexicon induction 1803 words (test) |
| Metric | AP |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 26 of 26 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AP](<https://www.sota2.com/research/sota/lexicon-induction-on-manually-validated-lexicon-induction-1803-words-test.md?metric=AP>): Higher is better; unit: PERCENT.

- [AUROC](<https://www.sota2.com/research/sota/lexicon-induction-on-manually-validated-lexicon-induction-1803-words-test.md?metric=AUROC>): Higher is better; unit: PERCENT.

## Recorded results

| Method | AP | Result date | Report paper |
| --- | --- | --- | --- |
| LISTN-C | 76.79 | Not recorded | 68fa79311e209131cea7c887 |
| LISTN-CA | 76.2 | Not recorded | 68fa79311e209131cea7c887 |
| LISTN-C | 75.54 | Not recorded | 68fa79311e209131cea7c887 |
| LISTN-C | 72.72 | Not recorded | 68fa79311e209131cea7c887 |
| LISTN-CA | 72.31 | Not recorded | 68fa79311e209131cea7c887 |
| LISTN-CA | 70.69 | Not recorded | 68fa79311e209131cea7c887 |
| LISTN-C | 70.4 | Not recorded | 68fa79311e209131cea7c887 |
| LISTN-CA | 69.5 | Not recorded | 68fa79311e209131cea7c887 |
| NPMI-category | 67.9 | Not recorded | 68fa79311e209131cea7c887 |
| NPMI | 67.09 | Not recorded | 68fa79311e209131cea7c887 |
| PPMI-category | 65.17 | Not recorded | 68fa79311e209131cea7c887 |
| NPMI-month | 64.49 | Not recorded | 68fa79311e209131cea7c887 |
| PPMI | 63.33 | Not recorded | 68fa79311e209131cea7c887 |
| LISTN-C | 62.97 | Not recorded | 68fa79311e209131cea7c887 |
| LISTN-CA | 62.28 | Not recorded | 68fa79311e209131cea7c887 |
| LISTN-CA | 61.9 | Not recorded | 68fa79311e209131cea7c887 |
| NPMI-subredit | 61.7 | Not recorded | 68fa79311e209131cea7c887 |
| PPMI-month | 61.65 | Not recorded | 68fa79311e209131cea7c887 |
| LISTN-C | 60.16 | Not recorded | 68fa79311e209131cea7c887 |
| PPMI-subreddit | 59.1 | Not recorded | 68fa79311e209131cea7c887 |
| LISTN-C | 58.91 | Not recorded | 68fa79311e209131cea7c887 |
| word2vec bootstrap | 55.63 | Not recorded | 68fa79311e209131cea7c887 |
| LISTN-CA | 55.19 | Not recorded | 68fa79311e209131cea7c887 |
| LISTN-CA | 53.49 | Not recorded | 68fa79311e209131cea7c887 |
| LISTN-C | 52.76 | Not recorded | 68fa79311e209131cea7c887 |
| Random | 52 | Not recorded | 68fa79311e209131cea7c887 |

### LISTN-C

AP: 76.79. Result ID: 6995d0953badfaffe6d58aaf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Cluster-5","K":"5"}. This record does not assert independent reproduction.

### LISTN-CA

AP: 76.2. Result ID: 6995d0953badfaffe6d58aa7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Cluster-5","K":"5"}. This record does not assert independent reproduction.

### LISTN-C

AP: 75.54. Result ID: 6995d0953badfaffe6d58ab0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Cluster-20","K":"20"}. This record does not assert independent reproduction.

### LISTN-C

AP: 72.72. Result ID: 6995d0953badfaffe6d58aad.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Category centroid"}. This record does not assert independent reproduction.

### LISTN-CA

AP: 72.31. Result ID: 6995d0953badfaffe6d58aa5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Category centroid"}. This record does not assert independent reproduction.

### LISTN-CA

AP: 70.69. Result ID: 6995d0953badfaffe6d58aa8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Cluster-20","K":"20"}. This record does not assert independent reproduction.

### LISTN-C

AP: 70.4. Result ID: 6995d0953badfaffe6d58ab1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Cluster-100","K":"100"}. This record does not assert independent reproduction.

### LISTN-CA

AP: 69.5. Result ID: 6995d0953badfaffe6d58aa9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Cluster-100","K":"100"}. This record does not assert independent reproduction.

### NPMI-category

AP: 67.9. Result ID: 6995d0953badfaffe6d58aa2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69511e209131cea21861.md>)

Recorded evaluation configuration: {"Granularity":"Category"}. This record does not assert independent reproduction.

### NPMI

AP: 67.09. Result ID: 6995d0953badfaffe6d58aa0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69511e209131cea21861.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PPMI-category

AP: 65.17. Result ID: 6995d0953badfaffe6d58a9e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69511e209131cea21861.md>)

Recorded evaluation configuration: {"Granularity":"Category"}. This record does not assert independent reproduction.

### NPMI-month

AP: 64.49. Result ID: 6995d0953badfaffe6d58aa3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69511e209131cea21861.md>)

Recorded evaluation configuration: {"Granularity":"Month"}. This record does not assert independent reproduction.

### PPMI

AP: 63.33. Result ID: 6995d0953badfaffe6d58a9c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69511e209131cea21861.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LISTN-C

AP: 62.97. Result ID: 6995d0953badfaffe6d58aac.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Community centroid"}. This record does not assert independent reproduction.

### LISTN-CA

AP: 62.28. Result ID: 6995d0953badfaffe6d58aa4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Community centroid"}. This record does not assert independent reproduction.

### LISTN-CA

AP: 61.9. Result ID: 6995d0953badfaffe6d58aab.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Bias"}. This record does not assert independent reproduction.

### NPMI-subredit

AP: 61.7. Result ID: 6995d0953badfaffe6d58aa1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69511e209131cea21861.md>)

Recorded evaluation configuration: {"Granularity":"Subreddit"}. This record does not assert independent reproduction.

### PPMI-month

AP: 61.65. Result ID: 6995d0953badfaffe6d58a9f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69511e209131cea21861.md>)

Recorded evaluation configuration: {"Granularity":"Month"}. This record does not assert independent reproduction.

### LISTN-C

AP: 60.16. Result ID: 6995d0953badfaffe6d58ab3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Bias"}. This record does not assert independent reproduction.

### PPMI-subreddit

AP: 59.1. Result ID: 6995d0953badfaffe6d58a9d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69511e209131cea21861.md>)

Recorded evaluation configuration: {"Granularity":"Subreddit"}. This record does not assert independent reproduction.

### LISTN-C

AP: 58.91. Result ID: 6995d0953badfaffe6d58aae.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Subreddit centroid"}. This record does not assert independent reproduction.

### word2vec bootstrap

AP: 55.63. Result ID: 6995d0953badfaffe6d58a9b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa61151e209131ce9f2ac1.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LISTN-CA

AP: 55.19. Result ID: 6995d0953badfaffe6d58aa6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Subreddit centroid"}. This record does not assert independent reproduction.

### LISTN-CA

AP: 53.49. Result ID: 6995d0953badfaffe6d58aaa.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Bootstrap"}. This record does not assert independent reproduction.

### LISTN-C

AP: 52.76. Result ID: 6995d0953badfaffe6d58ab2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

[Implementation](<https://github.com/unimelb-nlp/listn>)

Recorded evaluation configuration: {"Induction approach":"Bootstrap"}. This record does not assert independent reproduction.

### Random

AP: 52. Result ID: 6995d0953badfaffe6d58a9a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79311e209131cea7c887.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
