EEG-to-text decoding on THINGS EEG cross-exemplar evaluation suite v2
22.5ROUGE-1SENSE
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| SENSEAblation Configuration=Base, Decoder Model=Gemini 2.5 Flash Lite2026.05 | 22.5 | 4.2 | 21.2 | 13.2 | 2.4 | 15.1 | 88.2 | 4.7 | 1 | |
| SYNAPSEAblation Configuration=B1 (Full framework), Decoder Model=Qwen2.5-7B2026.05 | 21.8 | 3 | 18.9 | 19.4 | 2.9 | 16.7 | 87.4 | 4.2 | 1 | |
| SYNAPSEAblation Configuration=B2 (Full framework w/o Exemplars), Decoder Model=Qwen2.5-7B2026.05 | 21.5 | 2.5 | 18.1 | 19.4 | 2.7 | 16.8 | 87 | 3.9 | 1 | |
| SYNAPSEAblation Configuration=B1 (Full framework), Decoder Model=GPT-4o-mini2026.05 | 21.4 | 2.5 | 18.3 | 19.3 | 2.7 | 16.5 | 87.4 | 4.8 | 1 | |
| SYNAPSEAblation Configuration=B2 (Full framework w/o Exemplars), Decoder Model=Gemini 2.5 Flash Lite2026.05 | 21.4 | 2.4 | 18.4 | 18.5 | 2.7 | 16.3 | 87.2 | 4.3 | 1 | |
| SYNAPSEAblation Configuration=B1 (Full framework), Decoder Model=Gemini 2.5 Flash Lite2026.05 | 21.2 | 2.8 | 18.2 | 17.6 | 2.7 | 15.9 | 87.4 | 4.4 | 1 | |
| SENSEAblation Configuration=Base, Decoder Model=GPT-4o-mini2026.05 | 21.2 | 2.7 | 19.4 | 13.4 | 2.1 | 14.1 | 88.5 | 4.8 | 1 | |
| SYNAPSEAblation Configuration=B2 (Full framework w/o Exemplars), Decoder Model=GPT-4o-mini2026.05 | 21.1 | 2.1 | 18.1 | 18.4 | 2.5 | 15.9 | 87.4 | 4.7 | 1 | |
| SYNAPSEAblation Configuration=B1 (Full framework), Decoder Model=LLaMa-3-8B2026.05 | 20.3 | 3.9 | 18.3 | 17.8 | 3 | 17.1 | 87.4 | 4.5 | 1 | |
| SENSEAblation Configuration=Base, Decoder Model=LLaMa-3-8B2026.05 | 19.9 | 4.2 | 17.1 | 17.5 | 3.1 | 17.8 | 86.2 | 4.1 | 1 | |
| SYNAPSEAblation Configuration=B2 (Full framework w/o Exemplars), Decoder Model=LLaMa-3-8B2026.05 | 15.2 | 1.8 | 12.4 | 13.3 | 2.1 | 14.5 | 87 | 4.2 | 1 | |
| SENSEAblation Configuration=Base, Decoder Model=Qwen2.5-7B2026.05 | 9.4 | 1.2 | 8.5 | 3.6 | 0.7 | 4.3 | 84.7 | 2 | 1 |