# Simple Attention-Based Representation Learning for Ranking Short Social Media Posts

Source: [Simple Attention-Based Representation Learning for Ranking Short Social Media Posts](<https://www.sota2.com/research/paper/68fa66401e209131cea0f2ee>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T21:45:30.461Z

Authors: Peng Shi, Jinfeng Rao, Jimmy Lin

Published: 2018-11-02T17:57:42.000Z

## Abstract

This paper explores the problem of ranking short social media posts with respect to user queries using neural networks. Instead of starting with a complex architecture, we proceed from the bottom up and examine the effectiveness of a simple, word-level Siamese architecture augmented with attention-based mechanisms for capturing semantic "soft" matches between query and post tokens. Extensive experiments on datasets from the TREC Microblog Tracks show that our simple models not only achieve better effectiveness than existing approaches that are far more complex or exploit a more diverse set of relevance signals, but are also much faster. Implementations of our samCNN (Simple Attention-based Matching CNN) models are shared with the community to support future work.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Ad hoc document retrieval on TREC Microblog 2011 (test)](<https://www.sota2.com/research/sota/ad-hoc-document-retrieval-on-trec-microblog-2011-test.md>): Ad hoc document retrieval; TREC Microblog 2011 (test); AP: 42.93.

- [Ad hoc document retrieval on TREC Microblog 2012 (test)](<https://www.sota2.com/research/sota/ad-hoc-document-retrieval-on-trec-microblog-2012-test.md>): Ad hoc document retrieval; TREC Microblog 2012 (test); AP: 26.21.

- [Ad hoc document retrieval on TREC Microblog 2013 (test)](<https://www.sota2.com/research/sota/ad-hoc-document-retrieval-on-trec-microblog-2013-test.md>): Ad hoc document retrieval; TREC Microblog 2013 (test); AP: 29.9.

- [Ad hoc document retrieval on TREC Microblog 2014 (test)](<https://www.sota2.com/research/sota/ad-hoc-document-retrieval-on-trec-microblog-2014-test.md>): Ad hoc document retrieval; TREC Microblog 2014 (test); AP: 0.4563.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1811.01013>)

[PDF](<https://arxiv.org/pdf/1811.01013.pdf>)
