arrow
Return

Avoiding the eyeballing fallacy: Visualizing statistical differences between estimates using the pheatplot command

delete2025-03-01
delete0
PRE
AI
E
Elisa Brini *
S
Solveig Topstad Borgen
N
Nicolai T. Borgen
DOI:10.1177/1536867X251322962delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Graphical representations of coefficients and their confidence intervals are increasingly used in research presentations and publications because they are easier and quicker to read than tables. However, in coefficient plots that include several estimated coefficients, researchers often use confidence intervals to eyeball whether coefficients are statistically significant from each other, which results in an overly conservative test and increased risk of type II errors. To help avoid this eyeballing fallacy, we introduce the pheatplot postestimation command, which visualizes the statistical significance across estimates of categorical variables in a regression model. pheatplot efficiently compares the significance level between point estimates and helps researchers avoid making wrong assumptions about whether estimates differ. Moreover, by representing p-values as continuous measures rather than binary thresholds, it provides the flexibility to move beyond arbitrary cutoffs of statistical significance. This article offers some examples that illustrate the functionality of the pheatplot command.
Keywords:
gr0099
pheatplot
heatplot
lincom
coefplot
eyeballing fallacy
confidence intervals
p-values
statistical significance

Journal

S
Stata Journal
IF:
2.4
Papers:
1.2K
Citations:
8.4K

Organization

U
university of florence
Scholars:
4.1W
Papers: 3.1W
Citations: 42
U
university of oslo
Scholars:
4.2W
Papers: 3.5W
Citations: 53