# Knowledge-intensive NLP tasks on FEVER, NQ, WoW, and ZSRE

Source: [Knowledge-intensive NLP tasks on FEVER, NQ, WoW, and ZSRE](<https://www.sota2.com/research/sota/knowledge-intensive-nlp-tasks-on-fever-nq-wow-and-zsre>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:35:32.496Z

Evaluation covering Knowledge-intensive NLP tasks across the FEVER, NQ, WoW, and ZSRE datasets, reporting average performance.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Knowledge-intensive NLP tasks |
| Dataset (including any stated split) | FEVER, NQ, WoW, and ZSRE |
| Metric | Average Performance |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 4 of 4 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Average Performance](<https://www.sota2.com/research/sota/knowledge-intensive-nlp-tasks-on-fever-nq-wow-and-zsre.md?metric=Average%20Performance>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Average Performance | Result date | Report paper |
| --- | --- | --- | --- |
| UpperBound | 41.22 | Not recorded | 68fa6f781e209131cea45cf2 |
| PlugD | 39.68 | Not recorded | 68fa6f781e209131cea45cf2 |
| ED2LM | 37.39 | Not recorded | 68fa6f781e209131cea45cf2 |
| EmbRecy | 35.54 | Not recorded | 68fa6f781e209131cea45cf2 |

### UpperBound

Average Performance: 41.22. Result ID: 6990c2d63a6c314849031292.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f781e209131cea45cf2.md>)

Recorded evaluation configuration: {"FLOPs":"453.1 G","Time":"226 ms"}. This record does not assert independent reproduction.

### PlugD

Average Performance: 39.68. Result ID: 6990c2d63a6c314849031291.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f781e209131cea45cf2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f781e209131cea45cf2.md>)

[Implementation](<https://github.com/thunlp/Document-Plugin>)

Recorded evaluation configuration: {"FLOPs":"139.3 G","Time":"98 ms"}. This record does not assert independent reproduction.

### ED2LM

Average Performance: 37.39. Result ID: 6990c2d63a6c31484903128f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f781e209131cea45cf2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c651e209131cea33d11.md>)

Recorded evaluation configuration: {"FLOPs":"114.9 G","Time":"60 ms"}. This record does not assert independent reproduction.

### EmbRecy

Average Performance: 35.54. Result ID: 6990c2d63a6c314849031290.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f781e209131cea45cf2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e711e209131cea3fd1f.md>)

Recorded evaluation configuration: {"FLOPs":"197.5 G","Time":"142 ms"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
