Brain Question Answering on NSD (test)
46.33BLEU-1UMBRAE
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| UMBRAETrainable Parameters=146.57M, External LLM=Vicuna (13B), # Models=1, # Tasks=22026.05 | 46.33 | 31.42 | 23.56 | 41.93 | 42.12 | 156.81 | 33.7 | 69.57 | 75.22 | 91.33 | 25.48 | |
| Mind-Omni (BQA)Trainable Parameters=442M, External LLM=None, # Models=1, # Tasks=72026.05 | 23.18 | 15.83 | 11.86 | 50.13 | 52.91 | 223.98 | 43.28 | 70.65 | 76.72 | 81.96 | 24.37 | |
| OneLLMTrainable Parameters=7B, External LLM=LLaMA2 (7B), # Models=4, # Tasks=72026.05 | 19.27 | 13.77 | 10.76 | 42.83 | 45.63 | 223.67 | 37.43 | 67.46 | 73.41 | 91.93 | 19.12 |