Meeting Planning on Natural Plan Meeting Planning
49.8Success RateSMaRT
Evaluation Results
| Method | Links | |
|---|---|---|
| SMaRTModel=GPT-4, Number of shots=5-shot2025.10 | 49.8 | |
| CoTModel=GPT-4, Number of shots=5-shot2025.10 | 46.5 | |
| DirectModel=GPT-4, Number of shots=5-shot2025.10 | 46.3 | |
| LLM-as-a-JudgeModel=GPT-4, Number of shots=5-shot2025.10 | 45.1 | |
| SMaRTModel=Gemini-1.5, Number of shots=5-shot2025.10 | 27.8 | |
| LLM-as-a-JudgeModel=Gemini-1.5, Number of shots=5-shot2025.10 | 26.2 | |
| CoTModel=Gemini-1.5, Number of shots=5-shot2025.10 | 26 | |
| DirectModel=Gemini-1.5, Number of shots=5-shot2025.10 | 25.2 |