Entity Typing on FewNERD (test)
62.55Mean AccuracyProtoVerb+
Evaluation results
| Method | Links | |
|---|---|---|
| ProtoVerb+K (shots)=16, Tuning Strategy=Prompt-based tuning2022.03 | 62.55 | |
| SearchVerb+K (shots)=16, Tuning Strategy=Prompt-based tuning2022.03 | 61.7 | |
| ProtoVerbshots (K)=16, task-specific knowledge=false2022.03 | 61.29 | |
| ManualVerbK (shots)=16, Tuning Strategy=Prompt-based tuning2022.03 | 61.17 | |
| ManualVerbshots (K)=16, task-specific knowledge=true2022.03 | 61.17 | |
| SoftVerb+K (shots)=16, Tuning Strategy=Prompt-based tuning2022.03 | 59.23 | |
| SoftVerbshots (K)=16, task-specific knowledge=false2022.03 | 58.87 | |
| ProtoVerb+K (shots)=8, Tuning Strategy=Prompt-based tuning2022.03 | 58.3 | |
| ManualVerbK (shots)=8, Tuning Strategy=Prompt-based tuning2022.03 | 56.59 | |
| ManualVerbshots (K)=8, task-specific knowledge=true2022.03 | 56.59 | |
| SearchVerb+K (shots)=8, Tuning Strategy=Prompt-based tuning2022.03 | 56.58 | |
| ProtoVerbshots (K)=8, task-specific knowledge=false2022.03 | 56.06 | |
| SearchVerbshots (K)=16, task-specific knowledge=false2022.03 | 55.49 | |
| SoftVerb+K (shots)=8, Tuning Strategy=Prompt-based tuning2022.03 | 54.3 | |
| ProtoVerb+K (shots)=4, Tuning Strategy=Prompt-based tuning2022.03 | 54.16 | |
| SoftVerbshots (K)=8, task-specific knowledge=false2022.03 | 53.78 | |
| Fine-tuningK (shots)=16, Tuning Strategy=Standard fine-tuning2022.03 | 52.66 | |
| ManualVerbK (shots)=4, Tuning Strategy=Prompt-based tuning2022.03 | 52.54 | |
| ManualVerbshots (K)=4, task-specific knowledge=true2022.03 | 52.54 | |
| SearchVerbshots (K)=8, task-specific knowledge=false2022.03 | 50.78 | |
| SearchVerb+K (shots)=4, Tuning Strategy=Prompt-based tuning2022.03 | 50.61 | |
| Fine-tuningK (shots)=8, Tuning Strategy=Standard fine-tuning2022.03 | 49.77 | |
| SoftVerb+K (shots)=4, Tuning Strategy=Prompt-based tuning2022.03 | 49.45 | |
| SoftVerbshots (K)=4, task-specific knowledge=false2022.03 | 48.77 | |
| ProtoVerb+K (shots)=2, Tuning Strategy=Prompt-based tuning2022.03 | 48.69 | |
| ProtoVerbshots (K)=4, task-specific knowledge=false2022.03 | 48.28 | |
| ManualVerbK (shots)=2, Tuning Strategy=Prompt-based tuning2022.03 | 46.44 | |
| ManualVerbshots (K)=2, task-specific knowledge=true2022.03 | 46.44 | |
| ProtoVerb+K (shots)=1, Tuning Strategy=Prompt-based tuning2022.03 | 43.2 | |
| SearchVerbshots (K)=4, task-specific knowledge=false2022.03 | 43.1 | |
| SoftVerb+K (shots)=2, Tuning Strategy=Prompt-based tuning2022.03 | 42.17 | |
| SearchVerb+K (shots)=2, Tuning Strategy=Prompt-based tuning2022.03 | 42.13 | |
| ManualVerbK (shots)=1, Tuning Strategy=Prompt-based tuning2022.03 | 41.68 | |
| ManualVerbshots (K)=1, task-specific knowledge=true2022.03 | 41.68 | |
| SoftVerb+K (shots)=1, Tuning Strategy=Prompt-based tuning2022.03 | 37.66 | |
| ProtoVerbshots (K)=2, task-specific knowledge=false2022.03 | 35.72 | |
| SearchVerb+K (shots)=1, Tuning Strategy=Prompt-based tuning2022.03 | 35.64 | |
| ProtoVerb+K (shots)=4, Tuning Strategy=Without tuning (applied to un-tuned PLMs)2022.03 | 35.55 | |
| ProtoVerb+K (shots)=2, Tuning Strategy=Without tuning (applied to un-tuned PLMs)2022.03 | 34.44 | |
| ProtoVerb+K (shots)=8, Tuning Strategy=Without tuning (applied to un-tuned PLMs)2022.03 | 34.37 | |
| ProtoVerb+K (shots)=16, Tuning Strategy=Without tuning (applied to un-tuned PLMs)2022.03 | 33.96 | |
| SoftVerbshots (K)=2, task-specific knowledge=false2022.03 | 32.8 | |
| SearchVerbshots (K)=2, task-specific knowledge=false2022.03 | 31.28 | |
| ProtoVerb+K (shots)=1, Tuning Strategy=Without tuning (applied to un-tuned PLMs)2022.03 | 29.51 | |
| ProtoVerbshots (K)=1, task-specific knowledge=false2022.03 | 25 | |
| Fine-tuningK (shots)=4, Tuning Strategy=Standard fine-tuning2022.03 | 20.98 | |
| SearchVerbshots (K)=1, task-specific knowledge=false2022.03 | 20.88 | |
| ManualVerbK (shots)=0, Tuning Strategy=Prompt-based tuning2022.03 | 20 | |
| ManualVerbshots (K)=0, task-specific knowledge=true2022.03 | 20 | |
| Fine-tuningK (shots)=2, Tuning Strategy=Standard fine-tuning2022.03 | 19.03 | |
| SoftVerbshots (K)=1, task-specific knowledge=false2022.03 | 18.78 | |
| Fine-tuningK (shots)=1, Tuning Strategy=Standard fine-tuning2022.03 | 7.48 |