# Adversarial Claim Rewriting Fact Verification on FEVER

Source: [Adversarial Claim Rewriting Fact Verification on FEVER](<https://www.sota2.com/research/sota/adversarial-claim-rewriting-fact-verification-on-fever>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-10T08:32:04.021Z

Evaluation of model performance on the FEVER dataset specifically focusing on adversarial claim rewriting robustness, measured using metrics like ASR, VASR, and Core scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Fact Verification (Adversarial Claim Rewriting) |
| Dataset (including any stated split) | FEVER |
| Metric | ASR |
| Unit | PERCENT |
| Direction | Lower is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [ASR](<https://www.sota2.com/research/sota/adversarial-claim-rewriting-fact-verification-on-fever.md?metric=ASR>): Lower is better; unit: PERCENT.

- [VASR](<https://www.sota2.com/research/sota/adversarial-claim-rewriting-fact-verification-on-fever.md?metric=VASR>): Lower is better; unit: PERCENT.

- [Relation Score](<https://www.sota2.com/research/sota/adversarial-claim-rewriting-fact-verification-on-fever.md?metric=Relation%20Score>): Higher is better; unit: PERCENT.

- [Core Score](<https://www.sota2.com/research/sota/adversarial-claim-rewriting-fact-verification-on-fever.md?metric=Core%20Score>): Higher is better; unit: PERCENT.

- [Confidence Score](<https://www.sota2.com/research/sota/adversarial-claim-rewriting-fact-verification-on-fever.md?metric=Confidence%20Score>): Higher is better; unit: PERCENT.

- [Drift Metric](<https://www.sota2.com/research/sota/adversarial-claim-rewriting-fact-verification-on-fever.md?metric=Drift%20Metric>): Lower is better; unit: PERCENT.

- [Leakage Rate](<https://www.sota2.com/research/sota/adversarial-claim-rewriting-fact-verification-on-fever.md?metric=Leakage%20Rate>): Lower is better; unit: PERCENT.

- [SBERT Score](<https://www.sota2.com/research/sota/adversarial-claim-rewriting-fact-verification-on-fever.md?metric=SBERT%20Score>): Higher is better; unit: PERCENT.

- [Perplexity (PPL)](<https://www.sota2.com/research/sota/adversarial-claim-rewriting-fact-verification-on-fever.md?metric=Perplexity%20(PPL)>): Lower is better; unit: SCALAR.

## Recorded results

| Method | ASR | Result date | Report paper |
| --- | --- | --- | --- |
| GEM | 2.63 | Not recorded | 69d883ff7d0172140ec779d1 |
| Deception | 6.84 | Not recorded | 69d883ff7d0172140ec779d1 |
| Omission | 7.11 | Not recorded | 69d883ff7d0172140ec779d1 |
| Fact-Saboteurs | 8.16 | Not recorded | 69d883ff7d0172140ec779d1 |
| AdvAdd | 8.16 | Not recorded | 69d883ff7d0172140ec779d1 |
| AdvAdd | 13.5 | Not recorded | 69d883ff7d0172140ec779d1 |
| GEM | 16.32 | Not recorded | 69d883ff7d0172140ec779d1 |
| AdvAdd | 17.76 | Not recorded | 69d883ff7d0172140ec779d1 |
| GEM | 18.94 | Not recorded | 69d883ff7d0172140ec779d1 |
| Fact-Saboteurs | 33.75 | Not recorded | 69d883ff7d0172140ec779d1 |
| Omission | 36.68 | Not recorded | 69d883ff7d0172140ec779d1 |
| Deception | 45.89 | Not recorded | 69d883ff7d0172140ec779d1 |
| Deception | 51.84 | Not recorded | 69d883ff7d0172140ec779d1 |
| Omission | 55.5 | Not recorded | 69d883ff7d0172140ec779d1 |
| Fact-Saboteurs | 55.79 | Not recorded | 69d883ff7d0172140ec779d1 |

### GEM

ASR: 2.63. Result ID: 69d8b57f47f34ce924c18c9a.

[Reporting paper](<https://www.sota2.com/research/paper/69d883ff7d0172140ec779d1.md>)

Recorded evaluation configuration: {"Generator":"GPT-4"}. This record does not assert independent reproduction.

### Deception

ASR: 6.84. Result ID: 69d8b57f47f34ce924c18c97.

[Reporting paper](<https://www.sota2.com/research/paper/69d883ff7d0172140ec779d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa676c1e209131cea16130.md>)

Recorded evaluation configuration: {"Generator":"GPT-4"}. This record does not assert independent reproduction.

### Omission

ASR: 7.11. Result ID: 69d8b57f47f34ce924c18c9d.

[Reporting paper](<https://www.sota2.com/research/paper/69d883ff7d0172140ec779d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c2b1e209131cea32812.md>)

Recorded evaluation configuration: {"Generator":"GPT-4"}. This record does not assert independent reproduction.

### Fact-Saboteurs

ASR: 8.16. Result ID: 69d8b57f47f34ce924c18c94.

[Reporting paper](<https://www.sota2.com/research/paper/69d883ff7d0172140ec779d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fc91e209131cea47654.md>)

Recorded evaluation configuration: {"Generator":"GPT-4"}. This record does not assert independent reproduction.

### AdvAdd

ASR: 8.16. Result ID: 69d8b57f47f34ce924c18ca0.

[Reporting paper](<https://www.sota2.com/research/paper/69d883ff7d0172140ec779d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bd41e209131cea30652.md>)

Recorded evaluation configuration: {"Generator":"GPT-4"}. This record does not assert independent reproduction.

### AdvAdd

ASR: 13.5. Result ID: 69d8b57f47f34ce924c18ca1.

[Reporting paper](<https://www.sota2.com/research/paper/69d883ff7d0172140ec779d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bd41e209131cea30652.md>)

Recorded evaluation configuration: {"Generator":"Qwen2.5-32B"}. This record does not assert independent reproduction.

### GEM

ASR: 16.32. Result ID: 69d8b57f47f34ce924c18c9c.

[Reporting paper](<https://www.sota2.com/research/paper/69d883ff7d0172140ec779d1.md>)

Recorded evaluation configuration: {"Generator":"Mistral-7B"}. This record does not assert independent reproduction.

### AdvAdd

ASR: 17.76. Result ID: 69d8b57f47f34ce924c18ca2.

[Reporting paper](<https://www.sota2.com/research/paper/69d883ff7d0172140ec779d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bd41e209131cea30652.md>)

Recorded evaluation configuration: {"Generator":"Mistral-7B"}. This record does not assert independent reproduction.

### GEM

ASR: 18.94. Result ID: 69d8b57f47f34ce924c18c9b.

[Reporting paper](<https://www.sota2.com/research/paper/69d883ff7d0172140ec779d1.md>)

Recorded evaluation configuration: {"Generator":"Qwen2.5-32B"}. This record does not assert independent reproduction.

### Fact-Saboteurs

ASR: 33.75. Result ID: 69d8b57f47f34ce924c18c95.

[Reporting paper](<https://www.sota2.com/research/paper/69d883ff7d0172140ec779d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fc91e209131cea47654.md>)

Recorded evaluation configuration: {"Generator":"Qwen2.5-32B"}. This record does not assert independent reproduction.

### Omission

ASR: 36.68. Result ID: 69d8b57f47f34ce924c18c9f.

[Reporting paper](<https://www.sota2.com/research/paper/69d883ff7d0172140ec779d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c2b1e209131cea32812.md>)

Recorded evaluation configuration: {"Generator":"Mistral-7B"}. This record does not assert independent reproduction.

### Deception

ASR: 45.89. Result ID: 69d8b57f47f34ce924c18c98.

[Reporting paper](<https://www.sota2.com/research/paper/69d883ff7d0172140ec779d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa676c1e209131cea16130.md>)

Recorded evaluation configuration: {"Generator":"Qwen2.5-32B"}. This record does not assert independent reproduction.

### Deception

ASR: 51.84. Result ID: 69d8b57f47f34ce924c18c99.

[Reporting paper](<https://www.sota2.com/research/paper/69d883ff7d0172140ec779d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa676c1e209131cea16130.md>)

Recorded evaluation configuration: {"Generator":"Mistral-7B"}. This record does not assert independent reproduction.

### Omission

ASR: 55.5. Result ID: 69d8b57f47f34ce924c18c9e.

[Reporting paper](<https://www.sota2.com/research/paper/69d883ff7d0172140ec779d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c2b1e209131cea32812.md>)

Recorded evaluation configuration: {"Generator":"Qwen2.5-32B"}. This record does not assert independent reproduction.

### Fact-Saboteurs

ASR: 55.79. Result ID: 69d8b57f47f34ce924c18c96.

[Reporting paper](<https://www.sota2.com/research/paper/69d883ff7d0172140ec779d1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fc91e209131cea47654.md>)

Recorded evaluation configuration: {"Generator":"Mistral-7B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
