Target-Aspect-Sentiment Detection on Coursera
52.94F1 ScoreLLM
Evaluation Results
| Method | Links | |
|---|---|---|
| LLMMode=Fine-tuned2026.05 | 52.94 | |
| Para.Mode=Fine-tuned2026.05 | 51.86 | |
| MvPMode=Fine-tuned2026.05 | 50.97 | |
| LLM-MvP# Shots=1002026.05 | 49.12 | |
| LLM-MvP# Shots=502026.05 | 47.22 | |
| Self-consistency# Shots=1002026.05 | 46.83 | |
| Single-order# Shots=1002026.05 | 46.09 | |
| Self-consistency# Shots=502026.05 | 44.9 | |
| Single-order# Shots=502026.05 | 44.06 | |
| Gemma-3-27B ICLScenario=10 annotated examples, # Train=102026.03 | 41.69 | |
| LLM-MvP# Shots=102026.05 | 41.01 | |
| Reasoning# Shots=1002026.05 | 39.96 | |
| LLM-MvP# Shots=Avg.2026.05 | 39.79 | |
| Self-consistency# Shots=102026.05 | 39.44 | |
| LA-ABSA w/ DLOScenario=10 annotated examples, # Train=full2026.03 | 39.22 | |
| Single-order# Shots=102026.05 | 38.52 | |
| Self-consistency# Shots=Avg.2026.05 | 38.49 | |
| LA-ABSA w/ ParaphraseScenario=10 annotated examples, # Train=full2026.03 | 38.46 | |
| Single-order# Shots=Avg.2026.05 | 37.45 | |
| Reasoning# Shots=502026.05 | 36.92 | |
| Reasoning# Shots=Avg.2026.05 | 34.16 | |
| Reasoning# Shots=102026.05 | 33.5 | |
| LA-ABSA w/ ParaphraseScenario=0 annotated examples, # Train=full2026.03 | 30.92 | |
| LA-ABSA w/ DLOScenario=0 annotated examples, # Train=full2026.03 | 30.6 | |
| Gemma-3-27B (0-shot)Scenario=0 annotated examples, # Train=02026.03 | 29.5 | |
| Reasoning# Shots=02026.05 | 26.26 | |
| Self-consistency# Shots=02026.05 | 22.8 | |
| LLM-MvP# Shots=02026.05 | 21.81 | |
| Single-order# Shots=02026.05 | 21.13 |