Semantic Correctness Evaluation on RepoProver
82FaithfulnessNL vs. Lean
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| NL vs. LeanEvaluation Protocol=direct, Model=DeepSeek2026.06 | 82 | 1 | 18 | 78.4 | |
| NL vs. NLbEvaluation Protocol=round-trip, Model=GPT-oss-120b2026.06 | 69 | 11 | 19 | 78.4 |