# Lifelong Safety Adaptation on Safety Benchmarks (Final-day)

Source: [Lifelong Safety Adaptation on Safety Benchmarks (Final-day)](<https://www.sota2.com/research/sota/lifelong-safety-adaptation-on-safety-benchmarks-final-day>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-15T08:26:52.374Z

Evaluation of model performance on the final day evaluation set of the Safety Benchmarks suite, specifically measuring adaptation capabilities using the Final-day macro-F1 score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Lifelong Safety Adaptation |
| Dataset (including any stated split) | Safety Benchmarks (Final-day) |
| Metric | Final-day Macro F1 Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Final-day Macro F1 Score](<https://www.sota2.com/research/sota/lifelong-safety-adaptation-on-safety-benchmarks-final-day.md?metric=Final-day%20Macro%20F1%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Final-day Macro F1 Score | Result date | Report paper |
| --- | --- | --- | --- |
| LiSA | 96.2 | Not recorded | 6a06a876dbc836b87d829f20 |
| ReasoningBank | 93.6 | Not recorded | 6a06a876dbc836b87d829f20 |
| LiSA | 93.3 | Not recorded | 6a06a876dbc836b87d829f20 |
| LiSA | 91.7 | Not recorded | 6a06a876dbc836b87d829f20 |
| Synapse | 89.1 | Not recorded | 6a06a876dbc836b87d829f20 |
| ReasoningBank | 88.2 | Not recorded | 6a06a876dbc836b87d829f20 |
| Synapse | 87.8 | Not recorded | 6a06a876dbc836b87d829f20 |
| Synapse | 86.3 | Not recorded | 6a06a876dbc836b87d829f20 |
| AGrail | 85.7 | Not recorded | 6a06a876dbc836b87d829f20 |
| ReasoningBank | 85.7 | Not recorded | 6a06a876dbc836b87d829f20 |
| AGrail | 84.6 | Not recorded | 6a06a876dbc836b87d829f20 |
| AGrail | 83.2 | Not recorded | 6a06a876dbc836b87d829f20 |
| Pure Prediction | 81.8 | Not recorded | 6a06a876dbc836b87d829f20 |
| Pure Prediction | 81.8 | Not recorded | 6a06a876dbc836b87d829f20 |
| Pure Prediction | 81.8 | Not recorded | 6a06a876dbc836b87d829f20 |

### LiSA

Final-day Macro F1 Score: 96.2. Result ID: 6a06d86f47f34ce924ee7183.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

Recorded evaluation configuration: {"label-flip ratio (ρ)":"0%","Base Model":"Gemini-3.1-flash-lite","Number of seeds":"5"}. This record does not assert independent reproduction.

### ReasoningBank

Final-day Macro F1 Score: 93.6. Result ID: 6a06d86f47f34ce924ee7180.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7baf1e209131cea89df5.md>)

Recorded evaluation configuration: {"label-flip ratio (ρ)":"0%","Base Model":"Gemini-3.1-flash-lite","Number of seeds":"5"}. This record does not assert independent reproduction.

### LiSA

Final-day Macro F1 Score: 93.3. Result ID: 6a06d86f47f34ce924ee7184.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

Recorded evaluation configuration: {"label-flip ratio (ρ)":"10%","Base Model":"Gemini-3.1-flash-lite","Number of seeds":"5"}. This record does not assert independent reproduction.

### LiSA

Final-day Macro F1 Score: 91.7. Result ID: 6a06d86f47f34ce924ee7185.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

Recorded evaluation configuration: {"label-flip ratio (ρ)":"20%","Base Model":"Gemini-3.1-flash-lite","Number of seeds":"5"}. This record does not assert independent reproduction.

### Synapse

Final-day Macro F1 Score: 89.1. Result ID: 6a06d86f47f34ce924ee717d.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71d71e209131cea534a8.md>)

Recorded evaluation configuration: {"label-flip ratio (ρ)":"0%","Base Model":"Gemini-3.1-flash-lite","Number of seeds":"5"}. This record does not assert independent reproduction.

### ReasoningBank

Final-day Macro F1 Score: 88.2. Result ID: 6a06d86f47f34ce924ee7181.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7baf1e209131cea89df5.md>)

Recorded evaluation configuration: {"label-flip ratio (ρ)":"10%","Base Model":"Gemini-3.1-flash-lite","Number of seeds":"5"}. This record does not assert independent reproduction.

### Synapse

Final-day Macro F1 Score: 87.8. Result ID: 6a06d86f47f34ce924ee717e.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71d71e209131cea534a8.md>)

Recorded evaluation configuration: {"label-flip ratio (ρ)":"10%","Base Model":"Gemini-3.1-flash-lite","Number of seeds":"5"}. This record does not assert independent reproduction.

### Synapse

Final-day Macro F1 Score: 86.3. Result ID: 6a06d86f47f34ce924ee717f.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71d71e209131cea534a8.md>)

Recorded evaluation configuration: {"label-flip ratio (ρ)":"20%","Base Model":"Gemini-3.1-flash-lite","Number of seeds":"5"}. This record does not assert independent reproduction.

### AGrail

Final-day Macro F1 Score: 85.7. Result ID: 6a06d86f47f34ce924ee717a.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77011e209131cea706ad.md>)

[Implementation](<https://eddyluo1232.github.io/AGrail/>)

Recorded evaluation configuration: {"label-flip ratio (ρ)":"0%","Base Model":"Gemini-3.1-flash-lite","Number of seeds":"5"}. This record does not assert independent reproduction.

### ReasoningBank

Final-day Macro F1 Score: 85.7. Result ID: 6a06d86f47f34ce924ee7182.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7baf1e209131cea89df5.md>)

Recorded evaluation configuration: {"label-flip ratio (ρ)":"20%","Base Model":"Gemini-3.1-flash-lite","Number of seeds":"5"}. This record does not assert independent reproduction.

### AGrail

Final-day Macro F1 Score: 84.6. Result ID: 6a06d86f47f34ce924ee717b.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77011e209131cea706ad.md>)

[Implementation](<https://eddyluo1232.github.io/AGrail/>)

Recorded evaluation configuration: {"label-flip ratio (ρ)":"10%","Base Model":"Gemini-3.1-flash-lite","Number of seeds":"5"}. This record does not assert independent reproduction.

### AGrail

Final-day Macro F1 Score: 83.2. Result ID: 6a06d86f47f34ce924ee717c.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77011e209131cea706ad.md>)

[Implementation](<https://eddyluo1232.github.io/AGrail/>)

Recorded evaluation configuration: {"label-flip ratio (ρ)":"20%","Base Model":"Gemini-3.1-flash-lite","Number of seeds":"5"}. This record does not assert independent reproduction.

### Pure Prediction

Final-day Macro F1 Score: 81.8. Result ID: 6a06d86f47f34ce924ee7177.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

Recorded evaluation configuration: {"label-flip ratio (ρ)":"0%","Base Model":"Gemini-3.1-flash-lite","Number of seeds":"5"}. This record does not assert independent reproduction.

### Pure Prediction

Final-day Macro F1 Score: 81.8. Result ID: 6a06d86f47f34ce924ee7178.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

Recorded evaluation configuration: {"label-flip ratio (ρ)":"10%","Base Model":"Gemini-3.1-flash-lite","Number of seeds":"5"}. This record does not assert independent reproduction.

### Pure Prediction

Final-day Macro F1 Score: 81.8. Result ID: 6a06d86f47f34ce924ee7179.

[Reporting paper](<https://www.sota2.com/research/paper/6a06a876dbc836b87d829f20.md>)

Recorded evaluation configuration: {"label-flip ratio (ρ)":"20%","Base Model":"Gemini-3.1-flash-lite","Number of seeds":"5"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
