List your company
ResearchFormerly WizWand

Event Relation Extraction on Causal-TimeBank 1.0 (test)

31Micro F1Davinci
3.4410.59517.7524.905Oct 13, 2023
Updated 8mo ago

Evaluation results

MethodLinks
DavinciBackbone=text-davinci-003, prompting=w. all logical constraints2023.103121.8
TurboBackbone=gpt-3.5-turbo, prompting=CoT w. logical constraints2023.102712.8
GPT-4prompting=w. all logical constraints2023.102620
GPT-4prompting=CoT w. logical constraints2023.1024.524
GPT-4prompting=w. retrieved logical constraints2023.102413.5
DavinciBackbone=text-davinci-003, prompting=CoT w. logical constraints2023.102339.2
GPT-4prompting=vanilla CoT2023.102335
GPT-4prompting=vanilla ICL2023.1022.530.5
ROBERTa-Largemode=fully fine-tuned2023.1022.236.2
TurboBackbone=gpt-3.5-turbo, prompting=w. retrieved logical constraints2023.102211.3
DavinciBackbone=text-davinci-003, prompting=w. retrieved logical constraints2023.102240.5
DavinciBackbone=text-davinci-003, prompting=vanilla CoT2023.102164.7
TurboBackbone=gpt-3.5-turbo, prompting=w. all logical constraints2023.102036.8
TurboBackbone=gpt-3.5-turbo, prompting=vanilla ICL2023.101954
DavinciBackbone=text-davinci-003, prompting=w. post-processing2023.10190
GPT-4prompting=w. post-processing2023.10190
DavinciBackbone=text-davinci-003, prompting=vanilla ICL2023.101858.8
TurboBackbone=gpt-3.5-turbo, prompting=vanilla CoT2023.101730.3
TurboBackbone=gpt-3.5-turbo, prompting=w. post-processing2023.10150
Llama2-FTBackbone=Llama2-13B, Finetuning=LLM-ERL, prompting=CoT w. logical constraints2023.1013.313
Llama2Backbone=Llama2-13B, prompting=CoT w. logical constraints2023.101318.1
Vicuna-FTBackbone=Vicuna-13B, Finetuning=LLM-ERL, prompting=w. all logical constraints2023.1012.10
Llama2-FTBackbone=Llama2-13B, Finetuning=LLM-ERL, prompting=vanilla ICL2023.101222.7
Llama2-FTBackbone=Llama2-13B, Finetuning=LLM-ERL, prompting=w. all logical constraints2023.101223
Llama2Backbone=Llama2-13B, prompting=vanilla ICL2023.1011.526.7
Llama2-FTBackbone=Llama2-13B, Finetuning=LLM-ERL, prompting=vanilla CoT2023.1011.53
VicunaBackbone=Vicuna-13B, prompting=w. all logical constraints2023.101123.5
Llama2-FTBackbone=Llama2-13B, Finetuning=LLM-ERL, prompting=w. retrieved logical constraints2023.101119.4
Llama2-FTBackbone=Llama2-13B, Finetuning=LLM-ERL, prompting=w. post-processing2023.10110
Vicuna-FTBackbone=Vicuna-13B, Finetuning=LLM-ERL, prompting=w. retrieved logical constraints2023.1010.79.5
Llama2Backbone=Llama2-13B, prompting=vanilla CoT2023.1010.533.6
VicunaBackbone=Vicuna-13B, prompting=w. retrieved logical constraints2023.101026.7
Llama2Backbone=Llama2-13B, prompting=w. all logical constraints2023.101023.5
Llama2Backbone=Llama2-13B, prompting=w. retrieved logical constraints2023.109.526.7
Llama2Backbone=Llama2-13B, prompting=w. post-processing2023.109.50
VicunaBackbone=Vicuna-13B, prompting=w. post-processing2023.1090
Vicuna-FTBackbone=Vicuna-13B, Finetuning=LLM-ERL, prompting=CoT w. logical constraints2023.108.52
VicunaBackbone=Vicuna-13B, prompting=CoT w. logical constraints2023.10833.1
Vicuna-FTBackbone=Vicuna-13B, Finetuning=LLM-ERL, prompting=vanilla ICL2023.10835.5
Vicuna-FTBackbone=Vicuna-13B, Finetuning=LLM-ERL, prompting=w. post-processing2023.1080
Vicuna-FTBackbone=Vicuna-13B, Finetuning=LLM-ERL, prompting=vanilla CoT2023.107.552.5
VicunaBackbone=Vicuna-13B, prompting=vanilla CoT2023.10657.6
VicunaBackbone=Vicuna-13B, prompting=vanilla ICL2023.104.584.1