.png){kind=icon}
返回
Generalized word shift graphs: a method for visualizing and explaining pairwise comparisons between texts
.png){kind=icon}
OA
AI
DOI：10.1140/epjds/s13688-021-00260-3.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
A common task in computational text analyses is to quantify how two corpora differ according to a measurement like word frequency, sentiment, or information content. However, collapsing the texts' rich stories into a single number is often conceptually perilous, and it is difficult to confidently interpret interesting or unexpected textual patterns without looming concerns about data artifacts or measurement validity. To better capture fine-grained differences between texts, we introduce generalized word shift graphs, visualizations which yield a meaningful and interpretable summary of how individual words contribute to the variation between two texts for any measure that can be formulated as a weighted average. We show that this framework naturally encompasses many of the most commonly used approaches for comparing texts, including relative frequencies, dictionary scores, and entropy-based measures like the Kullback-Leibler and Jensen-Shannon divergences. Through a diverse set of case studies ranging from presidential speeches to tweets posted in urban green spaces, we demonstrate how generalized word shift graphs can be flexibly applied across domains for diagnostic investigation, hypothesis generation, and substantive interpretation. By providing a detailed lens into textual shifts between corpora, generalized word shift graphs help computational social scientists, digital humanists, and other text analysis practitioners fashion more robust scientific narratives.
Keyword:
Text as data
Data visualization
Word shift graphs
Sentiment analysis
Computational social science
Digital humanities
Natural language processing
Information theory
期刊
IF:
2.5
论文数:
704
被引数:
1.6K
机构
引用论文
.png){kind=icon}
Visualizing Velocity and Acceleration on Augmented Practice Mirror Self-Learning Support System of Physical Motion可视化物理运动的增强实践镜像自学习支持系统中的速度与加速度
PREAI
分享收藏
查看更多内容