Electromagnetic Signal Reasoning on EM-Bench
0.45Anti-CJ Rouge-L ScoreMERLIN
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| MERLIN2026.03 | 0.45 | 0.15 | 0.29 | 0.08 | 0.4 | 0.08 | 0.42 | 0.22 | |
| Qwen3-VL-4B-Instruct2026.03 | 0.43 | 0.14 | 0.31 | 0.09 | 0.31 | 0.06 | 0.28 | 0.1 | |
| Claude-4-SonnetInput Format=Textualized2026.03 | 0.11 | 0 | 0.1 | 0 | 0.1 | 0 | 0.12 | 0.01 | |
| Gemini-2.5-ProInput Format=Textualized2026.03 | 0.1 | 0 | 0.1 | 0 | 0.08 | 0 | 0.1 | 0 | |
| DeepSeek-v3.2-expInput Format=Textualized2026.03 | 0.05 | 0 | 0.06 | 0 | 0.09 | 0 | 0.09 | 0 | |
| GPT-5Input Format=Textualized2026.03 | 0.01 | 0 | 0 | 0 | 0.03 | 0 | 0.01 | 0 | |
| Qwen3-Next-80b-A3BInput Format=Textualized2026.03 | 0.01 | 0 | 0.01 | 0 | 0.03 | 0 | 0.01 | 0 |