Aspect-Sentiment-Query-Pair Extraction on Rest15
48.18F1 ScoreDLO
Evaluation results
| Method | Links | |
|---|---|---|
| DLOScenario=Full human set, # Train=full2026.03 | 48.18 | |
| ParaphraseScenario=Full human set, # Train=full2026.03 | 46.93 | |
| Gemma-3-27B ICLScenario=50 annotated examples, # Train=502026.03 | 41.74 | |
| LA-ABSA w/ DLOScenario=50 annotated examples, # Train=full2026.03 | 40.38 | |
| Gemma-3-27B ICLScenario=10 annotated examples, # Train=102026.03 | 39.95 | |
| LA-ABSA w/ ParaphraseScenario=50 annotated examples, # Train=full2026.03 | 37.61 | |
| LA-ABSA w/ DLOScenario=10 annotated examples, # Train=full2026.03 | 37.19 | |
| LA-ABSA w/ ParaphraseScenario=10 annotated examples, # Train=full2026.03 | 35.04 | |
| QAIEScenario=50 annotated examples, # Train=248.82026.03 | 33.87 | |
| EDAScenario=50 annotated examples, # Train=5502026.03 | 30.93 | |
| DS²-ABSAScenario=50 annotated examples, # Train=21,6k2026.03 | 28.93 | |
| DLOScenario=50 annotated examples, # Train=502026.03 | 26.63 | |
| ParaphraseScenario=50 annotated examples, # Train=502026.03 | 25.55 | |
| Gemma-3-27B (0-shot)Scenario=0 annotated examples, # Train=02026.03 | 24.73 | |
| LA-ABSA w/ DLOScenario=0 annotated examples, # Train=full2026.03 | 18.88 | |
| LA-ABSA w/ ParaphraseScenario=0 annotated examples, # Train=full2026.03 | 18.54 | |
| DS²-ABSAScenario=10 annotated examples, # Train=21,1k2026.03 | 18.19 | |
| QAIEScenario=10 annotated examples, # Train=45.22026.03 | 9.96 | |
| EDAScenario=10 annotated examples, # Train=1102026.03 | 9.34 | |
| DLOScenario=10 annotated examples, # Train=102026.03 | 4.37 | |
| ParaphraseScenario=10 annotated examples, # Train=102026.03 | 1.32 |