Attribute Extraction on WDC-PAVE (test)
90.54F1 ScoreGPT-4
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GPT-4demonstrations=10, val_examples=102024.03 | 90.54 | — | — | — | — | |
| GPT-3.5demonstrations=10, val_examples=102024.03 | 88.02 | -2.52 | — | — | — | |
| AVEQAtype=PLM-based2024.03 | 80.83 | -9.71 | — | — | — | |
| Llama3.1Paradigm=Generation, Evaluation Protocol=RAG2025.01 | 77.2 | — | 78.2 | 76.3 | 80.1 | |
| Llama3.1Paradigm=Generation, Evaluation Protocol=few-shot2025.01 | 75 | — | 76 | 74.1 | 79 | |
| Qwen2.5Paradigm=Generation, Evaluation Protocol=RAG2025.01 | 74.2 | — | 75.1 | 73.4 | 78.3 | |
| TACLRParadigm=Retrieval2025.01 | 72.6 | — | 74.3 | 70.9 | 80.3 | |
| Qwen2.5Paradigm=Generation, Evaluation Protocol=few-shot2025.01 | 72.2 | — | 72.2 | 72.3 | 76.2 | |
| MAVEQAtype=PLM-based2024.03 | 65.1 | -25.44 | — | — | — | |
| SU-OpenTagtype=PLM-based2024.03 | 60.44 | -30.1 | — | — | — | |
| Llama3.1Paradigm=Generation, Evaluation Protocol=fine-tune2025.01 | 59 | — | 57.7 | 60.4 | 64.5 | |
| Llama3.1Paradigm=Generation, Evaluation Protocol=zero-shot2025.01 | 58.6 | — | 56.6 | 60.8 | 64.6 | |
| Qwen2.5Paradigm=Generation, Evaluation Protocol=fine-tune2025.01 | 56.9 | — | 54.1 | 60 | 61.7 | |
| Qwen2.5Paradigm=Generation, Evaluation Protocol=zero-shot2025.01 | 55.8 | — | 51.9 | 60.3 | 60.8 | |
| BERT-CLSParadigm=Classification2025.01 | 20.5 | — | 68.9 | 12 | 23.4 |