# ColBERT: Using BERT Sentence Embedding in Parallel Neural Networks for Computational Humor

Source: [ColBERT: Using BERT Sentence Embedding in Parallel Neural Networks for Computational Humor](<https://www.sota2.com/research/paper/68fa72981e209131cea576a1>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-01-02T05:13:52.155Z

Authors: Issa Annamoradnejad, Gohar Zoghi

Published: 2020-04-27T13:10:11.000Z

## Abstract

Automation of humor detection and rating has interesting use cases in modern technologies, such as humanoid robots, chatbots, and virtual assistants. In this paper, we propose a novel approach for detecting and rating humor in short texts based on a popular linguistic theory of humor. The proposed technical method initiates by separating sentences of the given text and utilizing the BERT model to generate embeddings for each one. The embeddings are fed to separate lines of hidden layers in a neural network (one line for each sentence) to extract latent features. At last, the parallel lines are concatenated to determine the congruity and other relationships between the sentences and predict the target value. We accompany the paper with a novel dataset for humor detection consisting of 200,000 formal short texts. In addition to evaluating our work on the novel dataset, we participated in a live machine learning competition focused on rating humor in Spanish tweets. The proposed model obtained F1 scores of 0.982 and 0.869 in the humor detection experiments which outperform general and state-of-the-art models. The evaluation performed on two contrasting settings confirm the strength and robustness of the model and suggests two important factors in achieving high accuracy in the current task: 1) usage of sentence embeddings and 2) utilizing the linguistic structure of humor in designing the proposed model.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Humor Detection on ColBERT (test)](<https://www.sota2.com/research/sota/humor-detection-on-colbert-test.md>): Humor Detection; ColBERT (test); Accuracy: 98.2.

- [Complex Emotion Interpretation on EIBench](<https://www.sota2.com/research/sota/complex-emotion-interpretation-on-eibench.md>): Complex Emotion Interpretation; EIBench; Recall (LLaMA-3 Criteria): 20.37.

- [Emotional Intelligence Evaluation on EIBench Basic 1.0 (test)](<https://www.sota2.com/research/sota/emotional-intelligence-evaluation-on-eibench-basic-1-0-test.md>): Emotional Intelligence Evaluation; EIBench Basic 1.0 (test); Happy Score (LLaMA-3): 29.05.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2004.12765>)

[PDF](<https://arxiv.org/pdf/2004.12765.pdf>)

[Implementation](<https://github.com/Moradnejad/ColBERT-Using-BERT-Sentence-Embedding-for-Humor-Detection>)
