Attribute Extraction on SWDE (test)
80.7Movie AccuracyDOM-LM
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| DOM-LM# Seed=5, training_data=10% from seed websites, zero-shot=true2022.01 | 80.7 | 74.9 | 75.3 | 83.4 | 70.8 | 78.4 | 75.1 | 81.2 | 77.5 | |
| DOM-LM# Seed=2, training_data=10% from seed websites, zero-shot=true2022.01 | 71.9 | 64.9 | 73.3 | 79 | 64.8 | 72.4 | 64.8 | 68 | 69.9 | |
| ROBERTa-Structural# Seed=5, training_data=10% from seed websites, zero-shot=true2022.01 | 71.2 | 60.6 | 65.5 | 81.5 | 63.6 | 67 | 69.8 | 73.1 | 69 | |
| ROBERTa-Base# Seed=5, training_data=10% from seed websites, zero-shot=true2022.01 | 69.1 | 63.3 | 65.5 | 73.9 | 61.1 | 59.3 | 60.4 | 67.2 | 65 | |
| ROBERTa-Base# Seed=2, training_data=10% from seed websites, zero-shot=true2022.01 | 49.3 | 42.7 | 48.8 | 54.7 | 48.3 | 46.7 | 34.2 | 36.6 | 45.2 | |
| ROBERTa-Structural# Seed=2, training_data=10% from seed websites, zero-shot=true2022.01 | 47.7 | 45.4 | 52.8 | 56.6 | 51.9 | 52.1 | 48.6 | 46.5 | 50.2 | |
| SimpDOM# Seed=5, training_data=10% from seed websites, zero-shot=true2022.01 | 47.6 | 56 | 47.6 | 58.6 | 38 | 51.6 | 58.6 | 70 | 53.5 | |
| SimpDOM# Seed=2, training_data=10% from seed websites, zero-shot=true2022.01 | 34.6 | 47.2 | 44.6 | 43.4 | 34.6 | 43.4 | 28.8 | 59.8 | 42.1 |