Multimodal Relation Extraction on MRE-MI
85.93Precision (P)SAVER (full)
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SAVER (full)Modality=Multimodal, FLOPs (G/sample)=36, P90 (ms)=542026.05 | 85.93 | 84.57 | 85.24 | 0.104 | 0.82 | |
| Top-K by relevanceModality=Multimodal, FLOPs (G/sample)=51, P90 (ms)=772026.05 | 85.31 | 83.62 | 84.45 | 0.119 | 0.77 | |
| SAVER w/o J.ScoreModality=Multimodal, FLOPs (G/sample)=37, P90 (ms)=562026.05 | 85.28 | 84.12 | 84.7 | 0.111 | 0.8 | |
| GLRAModality=Multimodal, FLOPs (G/sample)=56, P90 (ms)=842026.05 | 85.23 | 83.81 | 84.51 | 0.117 | 0.78 | |
| SAVER (CGG+SIS)Modality=Multimodal, FLOPs (G/sample)=35, P90 (ms)=532026.05 | 85.14 | 84.33 | 84.73 | 0.107 | 0.81 | |
| RSRNeTModality=Multimodal, FLOPs (G/sample)=60, P90 (ms)=902026.05 | 84.78 | 83.06 | 83.89 | 0.129 | 0.74 | |
| SAVER w/o CGGModality=Multimodal, FLOPs (G/sample)=51, P90 (ms)=772026.05 | 84.46 | 83.18 | 83.81 | 0.124 | 0.76 | |
| Retrieval-Aug.Modality=Multimodal, FLOPs (G/sample)=55, P90 (ms)=822026.05 | 84.27 | 82.86 | 83.56 | 0.124 | 0.75 | |
| SAVER w/o SISModality=Multimodal, FLOPs (G/sample)=62, P90 (ms)=932026.05 | 84.13 | 82.74 | 83.43 | 0.136 | 0.74 | |
| All-Images Attn.Modality=Multimodal, FLOPs (G/sample)=62, P90 (ms)=932026.05 | 83.47 | 82.18 | 82.82 | 0.142 | 0.72 | |
| ModernBERT-onlyModality=Text-only, FLOPs (G/sample)=13, P90 (ms)=172026.05 | 82.37 | 79.84 | 81.09 | 0.147 | 0.68 | |
| DeBERTa-v3-onlyModality=Text-only, FLOPs (G/sample)=18, P90 (ms)=272026.05 | 81.53 | 79.48 | 80.49 | 0.153 | 0.66 | |
| HVPNeTModality=Multimodal, FLOPs (G/sample)=66, P90 (ms)=992026.05 | 73.87 | 76.82 | 75.32 | 0.168 | 0.63 |