Joint Entity and Relation Extraction on SciERC (test)
16GFLOPsLlama-3-8B
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Llama-3-8BParams=∼8B, Hardware=A30 GPU, Batch Size=82026.03 | 16 | 4.2 | 16 | — | |
| SciBERT+GCNParams=∼110M, Hardware=A30 GPU, Batch Size=82026.03 | 22 | 48.2 | 6.1 | — | |
| SciBERT+GATParams=∼110M, Hardware=A30 GPU, Batch Size=82026.03 | 22.1 | 46.8 | 6.3 | — | |
| HGEREParams=∼220M, Hardware=A30 GPU, Batch Size=82026.03 | 22.5 | 14.1 | 9.5 | — | |
| PL-MarkerParams=∼220M, Hardware=A30 GPU, Batch Size=82026.03 | 44 | 12.4 | 7.2 | — | |
| HGNetParams=∼293M, Hardware=A30 GPU, Batch Size=82026.03 | 44.7 | 14.6 | 10.5 | — | |
| Llama-3-70BParams=∼70B, Hardware=A30 GPU, Batch Size=82026.03 | 140 | 0.5 | — | — |