EF Grading on CAMUS Considerably reduced (test)
92AccuracyEchoAgent
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| EchoAgentCapabilities (H)=⋆, Capabilities (M)=⋆, Capabilities (E-H-M)=⋆2026.04 | 92 | 89.6 | |
| GPT-5*Capabilities (H)=✓, Capabilities (M)=✓, Capabilities (E-H-M)=✓2026.04 | 89 | 92.78 | |
| EchoONECapabilities (H)=✓, Capabilities (M)=✗, Capabilities (E-H-M)=✗2026.04 | 80 | 85.05 | |
| Deepseek-VL2Capabilities (H)=✗, Capabilities (M)=✓, Capabilities (E-H-M)=✗2026.04 | 80 | 21.82 | |
| Qwen2.5-7B-VLCapabilities (H)=✗, Capabilities (M)=✓, Capabilities (E-H-M)=✗2026.04 | 79 | 0 | |
| OnimiaNetCapabilities (H)=✓, Capabilities (M)=✗, Capabilities (E-H-M)=✗2026.04 | 78 | 83.62 | |
| H2formerCapabilities (H)=✓, Capabilities (M)=✗, Capabilities (E-H-M)=✗2026.04 | 63 | 72 | |
| MemSAMCapabilities (H)=✓, Capabilities (M)=✗, Capabilities (E-H-M)=✗2026.04 | 60 | 69.44 | |
| LLaVA-MedCapabilities (H)=✗, Capabilities (M)=✓, Capabilities (E-H-M)=✗2026.04 | 58 | 39.97 | |
| GPT-5Capabilities (H)=✗, Capabilities (M)=✓, Capabilities (E-H-M)=✗2026.04 | 55 | 52.08 |