Provenance Graph Synthesis on ClearScope E5
0.73DegreeGPT-5.1
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| GPT-5.1Model=GPT-5.12025.06 | 0.73 | 0.47 | 0.01 | 1.16 | 3 | 1.64 | 54 | 18 | |
| Claude-sonnet-4.5Model=Claude-sonnet-4.52025.06 | 0.61 | 1.01 | 0.02 | 1.11 | 3 | 1.71 | 60 | 19 | |
| Qwen3-maxModel=Qwen3-max2025.06 | 0.57 | 0.59 | 0 | 0.64 | 3 | 1.66 | 62 | 19 | |
| DeepSeek-v3.2Model=DeepSeek-v3.22025.06 | 0.56 | 0.49 | 0.01 | 0.93 | 3 | 1.64 | 41 | 19 | |
| ProvSynModel=ProvSyn2025.06 | 0.22 | 0.38 | 0 | 0.23 | 3.23 | 1.48 | 73 | 34 |