Aspect Sentiment Quad Prediction on FLIGHTABSA
64.49F1 ScoreLLM
Evaluation results
| Method | Links | |
|---|---|---|
| LLMMode=Fine-tuned2026.05 | 64.49 | |
| LLM-MvP# Shots=1002026.05 | 58.45 | |
| MvPMode=Fine-tuned2026.05 | 57.9 | |
| Para.Mode=Fine-tuned2026.05 | 57.76 | |
| Self-consistency# Shots=1002026.05 | 56.9 | |
| LLM-MvP# Shots=502026.05 | 56.3 | |
| Self-consistency# Shots=502026.05 | 55.14 | |
| Single-order# Shots=1002026.05 | 54.9 | |
| Single-order# Shots=502026.05 | 53.33 | |
| LLM-MvP# Shots=102026.05 | 51.46 | |
| Self-consistency# Shots=102026.05 | 49.82 | |
| LLM-MvP# Shots=Avg.2026.05 | 49.44 | |
| Self-consistency# Shots=Avg.2026.05 | 47.8 | |
| Single-order# Shots=102026.05 | 47.29 | |
| Reasoning# Shots=502026.05 | 46.88 | |
| Reasoning# Shots=1002026.05 | 45.28 | |
| Single-order# Shots=Avg.2026.05 | 44.96 | |
| Reasoning# Shots=Avg.2026.05 | 43.3 | |
| Reasoning# Shots=102026.05 | 42.62 | |
| Reasoning# Shots=02026.05 | 38.43 | |
| LLM-MvP# Shots=02026.05 | 31.54 | |
| Self-consistency# Shots=02026.05 | 29.35 | |
| Single-order# Shots=02026.05 | 24.32 |