Factual Precision Evaluation on Medical
87.3SAFEMistralINST
Evaluation Results
| Method | Links | |
|---|---|---|
| MistralINSTScenario=REP, CORE=w/o2024.07 | 87.3 | |
| MistralINSTScenario=INFO, CORE=w/o2024.07 | 83.6 | |
| MistralINSTScenario=NORMAL, CORE=w/o2024.07 | 83.4 | |
| MistralINSTScenario=NORMAL, CORE=w/2024.07 | 71.3 | |
| GPT-2Scenario=INFO, CORE=w/o2024.07 | 49.5 | |
| GPT-2Scenario=REP, CORE=w/o2024.07 | 39.5 | |
| MistralINSTScenario=INFO, CORE=w/2024.07 | 4.23 | |
| MistralINSTScenario=REP, CORE=w/2024.07 | 1.76 | |
| GPT-2Scenario=REP, CORE=w/2024.07 | 0.07 | |
| GPT-2Scenario=INFO, CORE=w/2024.07 | 0 |