Overall Evaluation on DEMO
6.779Overall ScoreGPT-4o
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-4oModel Category=Proprietary LLM, Evaluator=Gemini-1.5-Pro2024.12 | 6.779 | |
| DEMO-Qwen2-7BModel Category=DEMO Agent, Evaluator=Gemini-1.5-Pro2024.12 | 6.517 | |
| Claude-3.5-SonnetModel Category=Proprietary LLM, Evaluator=Gemini-1.5-Pro2024.12 | 6.435 | |
| GPT-4o-miniModel Category=Proprietary LLM, Evaluator=Gemini-1.5-Pro2024.12 | 6.416 | |
| Qwen2-72B-InstructModel Category=Open-sourced LLM, Evaluator=Gemini-1.5-Pro2024.12 | 6.405 | |
| Claude-3.5-HaikuModel Category=Proprietary LLM, Evaluator=Gemini-1.5-Pro2024.12 | 6.344 | |
| DEMO-Llama3.1-8BModel Category=DEMO Agent, Evaluator=Gemini-1.5-Pro2024.12 | 6.16 | |
| Llama-3.1-70B-InstructModel Category=Open-sourced LLM, Evaluator=Gemini-1.5-Pro2024.12 | 6.13 | |
| Qwen2-7B-InstructModel Category=Backbone LLM, Evaluator=Gemini-1.5-Pro2024.12 | 5.697 | |
| Llama3.1-8B-InstructModel Category=Backbone LLM, Evaluator=Gemini-1.5-Pro2024.12 | 5.473 |