# Selective Generation on TriviaQA (PRR AlignScore)

Source: [Selective Generation on TriviaQA (PRR AlignScore)](<https://www.sota2.com/research/sota/selective-generation-on-triviaqa-prr-alignscore>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-29T07:31:47.627Z

Evaluation of model performance on the TriviaQA dataset for Selective Generation tasks, specifically measured using the PRR (AlignScore) metric.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Selective Generation |
| Dataset (including any stated split) | TriviaQA |
| Metric | PRR (AlignScore) |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [PRR (AlignScore)](<https://www.sota2.com/research/sota/selective-generation-on-triviaqa-prr-alignscore.md?metric=PRR%20(AlignScore)>): Higher is better; unit: SCALAR.

## Recorded results

| Method | PRR (AlignScore) | Result date | Report paper |
| --- | --- | --- | --- |
| DegMat NLI Score Entail. | 0.714 | Not recorded | 68fa781c1e209131cea76d53 |
| SAR | 0.71 | Not recorded | 68fa781c1e209131cea76d53 |
| SentenceSAR | 0.703 | Not recorded | 68fa781c1e209131cea76d53 |
| SATRMD+MSP | 0.702 | Not recorded | 68fa781c1e209131cea76d53 |
| Perplexity | 0.689 | Not recorded | 68fa781c1e209131cea76d53 |
| Maximum Sequence Probability | 0.687 | Not recorded | 68fa781c1e209131cea76d53 |
| EigValLaplacian NLI Score Entail. | 0.669 | Not recorded | 68fa781c1e209131cea76d53 |
| Semantic Entropy | 0.669 | Not recorded | 68fa781c1e209131cea76d53 |
| Eccentricity NLI Score Entail. | 0.654 | Not recorded | 68fa781c1e209131cea76d53 |
| HUQ-SATRMD | 0.646 | Not recorded | 68fa781c1e209131cea76d53 |
| Lexical Similarity ROUGE-L | 0.621 | Not recorded | 68fa781c1e209131cea76d53 |
| EigenScore | 0.619 | Not recorded | 68fa781c1e209131cea76d53 |
| SAPLMA | 0.522 | Not recorded | 68fa781c1e209131cea76d53 |
| Factoscope | -0.046 | Not recorded | 68fa781c1e209131cea76d53 |

### DegMat NLI Score Entail.

PRR (AlignScore): 0.714. Result ID: 69f1b38a47f34ce924d7d671.

[Reporting paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73441e209131cea5b68d.md>)

Recorded evaluation configuration: {"Model":"Llama 8b v3.1"}. This record does not assert independent reproduction.

### SAR

PRR (AlignScore): 0.71. Result ID: 69f1b38a47f34ce924d7d675.

[Reporting paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73681e209131cea5c472.md>)

Recorded evaluation configuration: {"Model":"Llama 8b v3.1"}. This record does not assert independent reproduction.

### SentenceSAR

PRR (AlignScore): 0.703. Result ID: 69f1b38a47f34ce924d7d677.

[Reporting paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

Recorded evaluation configuration: {"Model":"Llama 8b v3.1"}. This record does not assert independent reproduction.

### SATRMD+MSP

PRR (AlignScore): 0.702. Result ID: 69f1b38a47f34ce924d7d67c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

Recorded evaluation configuration: {"Model":"Llama 8b v3.1"}. This record does not assert independent reproduction.

### Perplexity

PRR (AlignScore): 0.689. Result ID: 69f1b38a47f34ce924d7d670.

[Reporting paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f11e209131cea19446.md>)

Recorded evaluation configuration: {"Model":"Llama 8b v3.1"}. This record does not assert independent reproduction.

### Maximum Sequence Probability

PRR (AlignScore): 0.687. Result ID: 69f1b38a47f34ce924d7d66f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f11e209131cea19446.md>)

Recorded evaluation configuration: {"Model":"Llama 8b v3.1"}. This record does not assert independent reproduction.

### EigValLaplacian NLI Score Entail.

PRR (AlignScore): 0.669. Result ID: 69f1b38a47f34ce924d7d673.

[Reporting paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73441e209131cea5b68d.md>)

Recorded evaluation configuration: {"Model":"Llama 8b v3.1"}. This record does not assert independent reproduction.

### Semantic Entropy

PRR (AlignScore): 0.669. Result ID: 69f1b38a47f34ce924d7d676.

[Reporting paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f141e209131cea43bf3.md>)

Recorded evaluation configuration: {"Model":"Llama 8b v3.1"}. This record does not assert independent reproduction.

### Eccentricity NLI Score Entail.

PRR (AlignScore): 0.654. Result ID: 69f1b38a47f34ce924d7d672.

[Reporting paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73441e209131cea5b68d.md>)

Recorded evaluation configuration: {"Model":"Llama 8b v3.1"}. This record does not assert independent reproduction.

### HUQ-SATRMD

PRR (AlignScore): 0.646. Result ID: 69f1b38a47f34ce924d7d67b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

Recorded evaluation configuration: {"Model":"Llama 8b v3.1"}. This record does not assert independent reproduction.

### Lexical Similarity ROUGE-L

PRR (AlignScore): 0.621. Result ID: 69f1b38a47f34ce924d7d674.

[Reporting paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f11e209131cea19446.md>)

Recorded evaluation configuration: {"Model":"Llama 8b v3.1"}. This record does not assert independent reproduction.

### EigenScore

PRR (AlignScore): 0.619. Result ID: 69f1b38a47f34ce924d7d679.

[Reporting paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75521e209131cea67225.md>)

Recorded evaluation configuration: {"Model":"Llama 8b v3.1"}. This record does not assert independent reproduction.

### SAPLMA

PRR (AlignScore): 0.522. Result ID: 69f1b38a47f34ce924d7d67a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70ec1e209131cea4e0e6.md>)

Recorded evaluation configuration: {"Model":"Llama 8b v3.1"}. This record does not assert independent reproduction.

### Factoscope

PRR (AlignScore): -0.046. Result ID: 69f1b38a47f34ce924d7d678.

[Reporting paper](<https://www.sota2.com/research/paper/68fa781c1e209131cea76d53.md>)

Recorded evaluation configuration: {"Model":"Llama 8b v3.1"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
