Aspect-Sentiment-Query-Pair Extraction on Rest 16
59.79F1 ScoreDLO
Evaluation results
| Method | Links | |
|---|---|---|
| DLOScenario=Full human set, # Train=full2026.03 | 59.79 | |
| ParaphraseScenario=Full human set, # Train=full2026.03 | 57.93 | |
| Gemma-3-27B ICLScenario=50 annotated examples, # Train=502026.03 | 51.1 | |
| LA-ABSA w/ DLOScenario=50 annotated examples, # Train=full2026.03 | 49.85 | |
| LA-ABSA w/ ParaphraseScenario=50 annotated examples, # Train=full2026.03 | 46.76 | |
| Gemma-3-27B ICLScenario=10 annotated examples, # Train=102026.03 | 46.23 | |
| LA-ABSA w/ DLOScenario=10 annotated examples, # Train=full2026.03 | 46.2 | |
| LA-ABSA w/ ParaphraseScenario=10 annotated examples, # Train=full2026.03 | 44.59 | |
| DS²-ABSAScenario=50 annotated examples, # Train=21,6k2026.03 | 35.79 | |
| QAIEScenario=50 annotated examples, # Train=248.82026.03 | 35.21 | |
| EDAScenario=50 annotated examples, # Train=5502026.03 | 34.59 | |
| DLOScenario=50 annotated examples, # Train=502026.03 | 29.57 | |
| Gemma-3-27B (0-shot)Scenario=0 annotated examples, # Train=02026.03 | 28.96 | |
| LA-ABSA w/ DLOScenario=0 annotated examples, # Train=full2026.03 | 26.97 | |
| LA-ABSA w/ ParaphraseScenario=0 annotated examples, # Train=full2026.03 | 26.07 | |
| DS²-ABSAScenario=10 annotated examples, # Train=21,1k2026.03 | 23.52 | |
| ParaphraseScenario=50 annotated examples, # Train=502026.03 | 23.5 | |
| QAIEScenario=10 annotated examples, # Train=45.22026.03 | 14.78 | |
| EDAScenario=10 annotated examples, # Train=1102026.03 | 11.8 | |
| DLOScenario=10 annotated examples, # Train=102026.03 | 5.18 | |
| ParaphraseScenario=10 annotated examples, # Train=102026.03 | 3.56 |