arrow
返回

Veridical data science

delete2020-02-13
delete88
delete
OA
AI
B
Bin Yu *
K
Karl Kumbier
DOI:10.1073/pnas.1901326117delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Building and expanding on principles of statistics, machine learning, and scientific inquiry, we propose the predictability, computability, and stability (PCS) framework for veridical data science. Our framework, composed of both a workflow and documentation, aims to provide responsible, reliable, reproducible, and transparent results across the data science life cycle. The PCS workflow uses predictability as a reality check and considers the importance of computation in data collection/storage and algorithm design. It augments predictability and computability with an overarching stability principle. Stability expands on statistical uncertainty considerations to assess how human judgment calls impact data results through data and model/algorithm perturbations. As part of the PCS workflow, we develop PCS inference procedures, namely PCS perturbation intervals and PCS hypothesis testing, to investigate the stability of data results relative to problem formulation, data cleaning, modeling decisions, and interpretations. We illustrate PCS inference through neuroscience and genomics projects of our own and others. Moreover, we demonstrate its favorable performance over existing methods in terms of receiver operating characteristic (ROC) curves in high-dimensional, sparse linear model simulations, including a wide range of misspecified models. Finally, we propose PCS documentation based on R Markdown or Jupyter Notebook, with publicly available, reproducible codes and narratives to back up human choices made throughout an analysis. The PCS workflow and documentation are demonstrated in a genomics case study available on Zenodo.
Keyword:
stability
prediction
computation
data science
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

P
Proceedings of the National Academy of Sciences of the United States of America
IF:
9.1
论文数:
10.8W
被引数:
73.5W

机构

University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
引用论文

引用论文

Endogenous Stackelberg Leadership
err1999-07-01
err0
errOAAI
errEric van Damme; Sjaak Hurkens
err分享
err收藏
Increasing Transparency Through a Multiverse Analysis
err2016-09-29
err750
errOAAI
errSteegen, Sara; Tuerlinckx, Francis; Gelman, Andrew; Vanpaemel, Wolf
err分享
err收藏
A reflective display based on the electro-microfluidic assembly of particles within suppressed water-in-oil droplet array
err2023-12-05
err0
errOAAI
errShitao Shen; Haoqiang Feng; Yueming Deng; Shuting Xie; Zichuan Yi; Mingliang Jin; Guofu Zhou; Paul Mulvaney; Lingling Shui
err分享
err收藏
Interleukin-25: Key Regulator of Inflammatory and Autoimmune Diseases
err2011-11-01
err0
PREAI
errDavid Saadoun; Benjamin Terrier; Patrice Cacoub
err分享
err收藏
Effect of CWG methylation on expression of plant genes
err1999-07-26
err0
errOAAI
errSriharsa PRADHAN; Nigel A. R. URWIN; Gareth I. JENKINS; Roger L. P. ADAMS
err分享
err收藏
Dermoscopic features of combined melanocytic nevi
err2004-08-25
err0
PREAI
errVincenzo De Giorgi; Daniela Massi; Camilla Salvini; Elisa Trez; Francesca Mannone; Paolo Carli
err分享
err收藏
学者 查看更多内容