Scientific data visualization on MatPlotBench 1.0 (test)
61.16ScoreGPT-4
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4Evaluation protocol=MatPlotAgent, Visual Agent=GPT-4V2024.02 | 61.16 | |
| Magicoder-S-DS-6.7BEvaluation protocol=MatPlotAgent, Visual Agent=GPT-4V2024.02 | 51.7 | |
| GPT-4Evaluation protocol=Direct Decoding2024.02 | 48.86 | |
| GPT-3.5Evaluation protocol=MatPlotAgent, Visual Agent=GPT-4V2024.02 | 47.51 | |
| WizardCoder-Python-33B-V1.1Evaluation protocol=MatPlotAgent, Visual Agent=GPT-4V2024.02 | 45.96 | |
| GPT-4Evaluation protocol=Zero-Shot Chain-of-thought2024.02 | 45.42 | |
| Deepseek-coder-6.7B-instructEvaluation protocol=MatPlotAgent, Visual Agent=GPT-4V2024.02 | 39.45 | |
| Magicoder-S-DS-6.7BEvaluation protocol=Direct Decoding2024.02 | 38.49 | |
| GPT-3.5Evaluation protocol=Direct Decoding2024.02 | 38.03 | |
| Magicoder-S-DS-6.7BEvaluation protocol=Zero-Shot Chain-of-thought2024.02 | 37.95 | |
| GPT-3.5Evaluation protocol=Zero-Shot Chain-of-thought2024.02 | 37.14 | |
| WizardCoder-Python-33B-V1.1Evaluation protocol=Direct Decoding2024.02 | 36.94 | |
| Deepseek-coder-33B-instructEvaluation protocol=Zero-Shot Chain-of-thought2024.02 | 36.1 | |
| WizardCoder-Python-33B-V1.1Evaluation protocol=Zero-Shot Chain-of-thought2024.02 | 35.81 | |
| Deepseek-coder-33B-instructEvaluation protocol=MatPlotAgent, Visual Agent=GPT-4V2024.02 | 32.18 | |
| Deepseek-coder-6.7B-instructEvaluation protocol=Direct Decoding2024.02 | 31.53 | |
| Deepseek-coder-33B-instructEvaluation protocol=Direct Decoding2024.02 | 30.88 | |
| Deepseek-coder-6.7B-instructEvaluation protocol=Zero-Shot Chain-of-thought2024.02 | 29.16 | |
| CodeLlama-34B-InstructEvaluation protocol=Direct Decoding2024.02 | 16.54 | |
| CodeLlama-34B-InstructEvaluation protocol=MatPlotAgent, Visual Agent=GPT-4V2024.02 | 14.18 | |
| CodeLlama-34B-InstructEvaluation protocol=Zero-Shot Chain-of-thought2024.02 | 12.4 |