Dependency relationship identification on BREX
76.4F1 ScoreGemini-2.5-Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini-2.5-ProSource Category=Closed source2025.05 | 76.4 | |
| Gemini-2.5-FlashSource Category=Closed source2025.05 | 62.9 | |
| DeepSeek-3.2-expSource Category=Open source2025.05 | 60.1 | |
| GPT-5Source Category=Closed source2025.05 | 58.9 | |
| Qwen3-235B-ThinkingSource Category=Open source2025.05 | 58.6 | |
| DeepSeek-R1Source Category=Open source2025.05 | 57.6 | |
| DeepSeek-3.1Source Category=Open source2025.05 | 57.5 | |
| Qwen3-235B-InstructSource Category=Open source2025.05 | 55.4 | |
| GPT-5-miniSource Category=Closed source2025.05 | 55 | |
| Kimi-k2-ThinkingSource Category=Open source2025.05 | 50 | |
| Qwen3-30B-ThinkingSource Category=Open source2025.05 | 48.5 | |
| Kimi-k2-InstructSource Category=Open source2025.05 | 48.2 | |
| Qwen3-30B-InstructSource Category=Open source2025.05 | 42.5 |