Visual Formatting on Talk-to-your-Slides VisFmt 1.0 (test)
96.1Success Rate (SR)TALK-TO-YOUR-SLIDES
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| TALK-TO-YOUR-SLIDESModel=DeepSeek V3 (0324)2025.05 | 96.1 | 2.02 | 2.05 | 1.73 | 2.27 | 1.9 | 82.3 | 4.18 | 2.11 | 1.6 | |
| TALK-TO-YOUR-SLIDESModel=Gemini-2.5-flash2025.05 | 94.3 | 1.98 | 2.22 | 1.86 | 2.38 | 2.16 | 94.78 | 5.09 | 3.58 | 2.8 | |
| UI AgentModel=DeepSeek V3 (0324)2025.05 | 88.75 | 2.46 | 1.91 | 1.68 | 1.81 | 1.5 | 122.4 | 90.1 | 2.38 | 5.8 | |
| UI AgentModel=Gemini-2.5-flash2025.05 | 86.18 | 2.61 | 2.01 | 1.72 | 2.25 | 1.8 | 122.25 | 93.27 | 2.15 | 15.2 | |
| Direct code gen.Model=DeepSeek V3 (0324)2025.05 | 79.02 | 0.54 | 0.75 | 1.04 | 1.03 | 0.87 | 15.92 | 1.12 | 0.43 | 0.5 | |
| Direct code gen.Model=Gemini-2.5-flash2025.05 | 53.66 | 0.44 | 0.84 | 1.04 | 1.04 | 0.89 | 37.72 | 1.38 | 2.75 | 1.9 |