Synthetic Data Fidelity on BGL, Thunderbird, Hadoop, and OpenStack (full)
98.5TVRLogSynthFSM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LogSynthFSMType=Ours2026.05 | 98.5 | 0.091 | 0.503 | |
| GraphMasterType=LLM-Syn2026.05 | 95.9 | 0.137 | 0.524 | |
| Synthesis-LLMType=LLM-Syn2026.05 | 95.2 | 0.146 | 0.537 | |
| Mixed-LLMType=LLM-Syn2026.05 | 94.8 | 0.149 | 0.545 | |
| LLM4NGType=LLM-Syn2026.05 | 94.4 | 0.155 | 0.563 | |
| GAGType=LLM-Syn2026.05 | 93.1 | 0.162 | 0.592 | |
| GraphAdasynType=Classic-Syn2026.05 | 91.2 | 0.176 | 0.651 | |
| FG-SMOTEType=Classic-Syn2026.05 | 90.6 | 0.179 | 0.659 | |
| GraphSMOTEType=Classic-Syn2026.05 | 90.3 | 0.181 | 0.662 | |
| G-MixupType=Classic-Syn2026.05 | 89.8 | 0.187 | 0.671 | |
| AGMixupType=Classic-Syn2026.05 | 89.3 | 0.195 | 0.676 | |
| GraphEditType=LLM-Aug2026.05 | 88.9 | 0.189 | 0.681 | |
| LLM4RGNNType=LLM-Aug2026.05 | 88.1 | 0.196 | 0.694 | |
| IntraMixType=Classic-Syn2026.05 | 87.6 | 0.209 | 0.708 | |
| GAugOType=Classic-Aug2026.05 | 87.1 | 0.203 | 0.721 | |
| Original ModelType=Original2026.05 | 86.2 | 0.214 | 0.742 |