arrow
Return

Improving Text Analysis Using Sentence Conjunctions and Punctuation

delete2020-07-01
delete18
delete
OA
AI
J
Joachim Büschken *
G
Greg M. Allenby
DOI:10.1287/mksc.2019.1214delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
User-generated content in the form of customer reviews, blogs, and tweets is an emerging and rich source of data for marketers. Topic models have been successfully applied to such data, demonstrating that empirical text analysis benefits greatly from a latent variable approach that summarizes high-level interactions among words. We propose a new topic model that allows for serial dependency of topics in text. That is, topics may carry over from word to word in a document, violating the bag-of-words assumption in traditional topic models. In the proposed model, topic carryover is informed by sentence conjunctions and punctuation. Typically, such observed information is eliminated prior to analyzing text data (i.e., preprocessing) because words such as and and but do not differentiate topics. We find that these elements of grammar contain information relevant to topic changes. We examine the performance of our models using multiple data sets and establish boundary conditions for when our model leads to improved inference about customer evaluations. Implications and opportunities for future research are discussed.
Keywords:
user-generated content
latent Dirichlet allocation (LDA)
topic dependency
syntactic covariates
Bayesian analysis
customer satisfaction analysis
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of the Academy of Marketing Science cover
Journal of the Academy of Marketing Science
IF:
10.1
Papers:
3.4K
Citations:
2.2W

Organization

U
University System of Ohio
Scholars:
15.4W
Papers: 13.0W
Citations: 200
O
Ohio State University
Scholars:
4.1W
Papers: 3.2W
Citations: 80