Product Attribute-Value Identification on Xianyu-PAVI (test)
86.9PrecisionLlama3.1
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Llama3.1Paradigm=Generation, Evaluation Protocol=fine-tune2025.01 | 86.9 | 82.7 | 84.7 | |
| TACLRParadigm=Retrieval2025.01 | 85.4 | 87.1 | 86.2 | |
| Qwen2.5Paradigm=Generation, Evaluation Protocol=fine-tune2025.01 | 84.5 | 79.1 | 81.7 | |
| Qwen2.5Paradigm=Generation, Evaluation Protocol=RAG2025.01 | 58.3 | 69.1 | 63.2 | |
| BERT-CLSParadigm=Classification2025.01 | 50.9 | 50.1 | 50.5 | |
| Qwen2.5Paradigm=Generation, Evaluation Protocol=few-shot2025.01 | 45.8 | 58.6 | 51.4 | |
| Qwen2.5Paradigm=Generation, Evaluation Protocol=zero-shot2025.01 | 42.7 | 55.7 | 48.4 | |
| Llama3.1Paradigm=Generation, Evaluation Protocol=RAG2025.01 | 40.8 | 57.2 | 47.6 | |
| Llama3.1Paradigm=Generation, Evaluation Protocol=few-shot2025.01 | 31 | 51.1 | 38.6 | |
| Llama3.1Paradigm=Generation, Evaluation Protocol=zero-shot2025.01 | 29.1 | 46.2 | 35.7 |