arrow
返回

Exploring evidence selection with the inclusion network

delete2024-03-01
delete0
delete
OA
AI
Y
Yuanxi Fu
C
Caitlin Clarke
M
Mark Van Moer
J
Jodi Schneider *
DOI:10.1162/qss_a_00287delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Although systematic reviews are intended to provide trusted scientific knowledge to meet the needs of decision-makers, their reliability can be threatened by bias and irreproducibility. To help decision-makers assess the risks in systematic reviews that they intend to use as the foundation of their action, we designed and tested a new approach to analyzing the evidence selection of a review: its coverage of the primary literature and its comparison to other reviews. Our approach could also help anyone using or producing reviews understand diversity or convergence in evidence selection. The basis of our approach is a new network construct called the inclusion network, which has two types of nodes: primary study reports (PSRs, the evidence) and systematic review reports (SRRs). The approach assesses risks in a given systematic review (the target SRR) by first constructing an inclusion network of the target SRR and other systematic reviews studying similar research questions (the companion SRRs) and then applying a three-step assessment process that utilizes visualizations, quantitative network metrics, and time series analysis. This paper introduces our approach and demonstrates it in two case studies. We identified the following risks: missing potentially relevant evidence, epistemic division in the scientific community, and recent instability in evidence selection standards. We also compare our inclusion network approach to knowledge assessment approaches based on another influential network construct, the claim-specific citation network, discuss current limitations of the inclusion network approach, and present directions for future work.
Keyword:
claim-specific citation networks
decision making
evidence selection discordance
evidence synthesis
Jaccard similarity
specialized-purpose citation networks

期刊

Quantitative Science Studies 封面图
Quantitative Science Studies
IF:
3.5
论文数:
371
被引数:
1.7K

机构

U
University of Illinois Urbana-Champaign
学者数:
2.4W
论文数: 2.0W
被引数: 35
University of Illinois System 封面图
University of Illinois System
学者数:
6.9W
论文数: 6.2W
被引数: 644
引用论文

引用论文

A bivariate Dirichlet process
err2003-08-01
err0
PREAI
errStephen Walker; Pietro Muliere
err分享
err收藏
Scientific citations favor positive results: a systematic review and meta-analysis
err2017-08-01
err131
errOAAI
errDuyx, Bram; Urlings, Miriam J. E.; Swaen, Gerard M. H.; Bouter, Lex M.; Zeegers, Maurice P.
err分享
err收藏
PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic ReviewsPrisma-s: 对PRISMA声明的扩展,用于报告系统综述中的文献搜索
err2021-01-26
err1.4K
errOAAI
errRethlefsen, Melissa L.; Kirtley, Shona; Waffenschmidt, Siw; Ayala, Ana Patricia; Moher, David; Page, Matthew J.; Koffel, Jonathan B.
err分享
err收藏
A systematic review and critical assessment of 11 discordant meta-analyses on reduced-function CYP2C19 genotype and risk of adverse clinical outcomes in clopidogrel users
err2015-01-01
err36
errOAAI
errOsnabrugge, Ruben L.; Head, Stuart J.; Zijlstra, Felix; ten Berg, Jurrien M.; Hunink, Myriam G.; Kappetein, A. Pieter; Janssens, A. Cecile J. W.
err分享
err收藏
Salt And Public Health: Contested Science And The Challenge Of Evidence-Based Decision Making
err2012-12-01
err40
PREAI
errBayer, Ronald; Johns, David Merritt; Galea, Sandro
err分享
err收藏
学者 查看更多内容