Slide Structure on Talk-to-your-Slides (SlideStruct) 1.0 (test)
91.7Success Rate (SR)TALK-TO-YOUR-SLIDES
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| TALK-TO-YOUR-SLIDESModel=DeepSeek V3 (0324)2025.05 | 91.7 | 1.41 | 2.46 | 2.61 | 2.81 | 2.92 | 69 | 2.2 | 1.26 | 0.8 | |
| TALK-TO-YOUR-SLIDESModel=Gemini-2.5-flash2025.05 | 91.1 | 1.71 | 1.95 | 1.73 | 2.17 | 2.35 | 96.54 | 2.71 | 1.69 | 1.2 | |
| Direct code gen.Model=DeepSeek V3 (0324)2025.05 | 85.02 | 0.18 | 1.8 | 1.12 | 1.93 | 1.66 | 17.1 | 0.89 | 0.62 | 0.6 | |
| UI AgentModel=DeepSeek V3 (0324)2025.05 | 82.74 | 1.56 | 2.28 | 1.32 | 2.1 | 2.01 | 88.3 | 73.1 | 1.72 | 4.2 | |
| UI AgentModel=Gemini-2.5-flash2025.05 | 82.22 | 1.67 | 2.31 | 1.55 | 2.38 | 2.17 | 99.18 | 72.46 | 1.82 | 12 | |
| Direct code gen.Model=Gemini-2.5-flash2025.05 | 73.33 | 0.5 | 1.61 | 1.25 | 1.58 | 1.72 | 28.17 | 1 | 1.05 | 0.8 |