Aspect Sentiment Quad Prediction on HOTELS
56.54F1 ScoreLLM
Evaluation results
| Method | Links | |
|---|---|---|
| LLMMode=Fine-tuned2026.05 | 56.54 | |
| LLM-MvP# Shots=1002026.05 | 55.11 | |
| MvPMode=Fine-tuned2026.05 | 55.03 | |
| Para.Mode=Fine-tuned2026.05 | 53.87 | |
| LLM-MvP# Shots=502026.05 | 53.2 | |
| Self-consistency# Shots=1002026.05 | 51.69 | |
| Self-consistency# Shots=502026.05 | 49.88 | |
| Single-order# Shots=1002026.05 | 49.66 | |
| LLM-MvP# Shots=102026.05 | 48.8 | |
| Single-order# Shots=502026.05 | 47.74 | |
| Self-consistency# Shots=102026.05 | 47.47 | |
| LLM-MvP# Shots=Avg.2026.05 | 46.48 | |
| Single-order# Shots=102026.05 | 44.27 | |
| Self-consistency# Shots=Avg.2026.05 | 42.84 | |
| Reasoning# Shots=502026.05 | 42.3 | |
| Reasoning# Shots=1002026.05 | 42.26 | |
| Single-order# Shots=Avg.2026.05 | 40.15 | |
| Reasoning# Shots=102026.05 | 39.91 | |
| Reasoning# Shots=Avg.2026.05 | 39.27 | |
| Reasoning# Shots=02026.05 | 32.61 | |
| LLM-MvP# Shots=02026.05 | 28.83 | |
| Self-consistency# Shots=02026.05 | 22.32 | |
| Single-order# Shots=02026.05 | 18.91 |