Recap Identification on RECIDENT GOT (Game of Thrones) (test)
34.9Precision@5NARCO (Full)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| NARCO (Full)Backbone LLM=GPT-4 (gpt-4-1106-preview), Mode=Zero-shot, Configuration=Full interpolation by Eq (1)2024.02 | 34.9 | 46.93 | 40.03 | |
| NARCO (Full)Backbone LLM=ChatGPT (gpt-3.5-turbo-1106), Mode=Zero-shot, Configuration=Full interpolation by Eq (1)2024.02 | 33.04 | 43.27 | 37.47 | |
| Listwise + Char-Filter (BL)Backbone LLM=ChatGPT (gpt-3.5-turbo-1106), Mode=Zero-shot2024.02 | 31.94 | 38.87 | 35.07 | |
| Listwise + Char-Filter (BL)Backbone LLM=GPT-4 (gpt-4-1106-preview), Mode=Zero-shot2024.02 | 31.49 | 40.38 | 35.38 | |
| NARCO (Rel)Backbone LLM=GPT-4 (gpt-4-1106-preview), Mode=Zero-shot, Configuration=Ranking by edge relations only2024.02 | 31.18 | 42.05 | 35.81 | |
| NARCO (Rel)Backbone LLM=ChatGPT (gpt-3.5-turbo-1106), Mode=Zero-shot, Configuration=Ranking by edge relations only2024.02 | 28.63 | 37.09 | 32.31 |