arrow
Return

Improving reference prioritisation with PICO recognition

delete2019-12-05
delete31
delete
OA
AI
A
Austin J. Brockmeier
M
Meizhi Ju
P
Piotr Przybyła
S
Sophia Ananiadou *
DOI:10.1186/s12911-019-0992-8delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Background: Machine learning can assist with multiple tasks during systematic reviews to facilitate the rapid retrieval of relevant references during screening and to identify and extract information relevant to the study characteristics, which include the PICO elements of patient/population, intervention, comparator, and outcomes. The latter requires techniques for identifying and categorising fragments of text, known as named entity recognition. Methods: A publicly available corpus of PICO annotations on biomedical abstracts is used to train a named entity recognition model, which is implemented as a recurrent neural network. This model is then applied to a separate collection of abstracts for references from systematic reviews within biomedical and health domains. The occurrences of words tagged in the context of specific PICO contexts are used as additional features for a relevancy classification model. Simulations of the machine learning-assisted screening are used to evaluate the work saved by the relevancy model with and without the PICO features. Chi-squared and statistical significance of positive predicted values are used to identify words that are more indicative of relevancy within PICO contexts. Results: Inclusion of PICO features improves the performance metric on 15 of the 20 collections, with substantial gains on certain systematic reviews. Examples of words whose PICO context are more precise can explain this increase. Conclusions: Words within PICO tagged segments in abstracts are predictive features for determining inclusion. Combining PICO annotation model into the relevancy classification pipeline is a promising approach. The annotations may be useful on their own to aid users in pinpointing necessary information for data extraction, or to facilitate semantic search.
Keywords:
Active learning
Evidence-based medicine
Logistic regression
Machine learning
Text mining
Systematic review
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

BMC Medical Informatics and Decision Making cover
BMC Medical Informatics and Decision Making
IF:
3.8
Papers:
4.4K
Citations:
1.2W

Organization

U
University of Manchester
Scholars:
5.7W
Papers: 5.3W
Citations: 7.4W
Cited Papers

Cited Papers

Septic a trial thrombus
err2007-02-22
err0
PREAI
errP. JOSHI; A. BULLINGHAM; N. SONI
errShare
errSave
Translation of PDGF Cardioprotective Pathways
err2003-01-01
err0
PREAI
errJay M. Edelberg; Dongqing Cai; Munira Xaymardan
errShare
errSave
A Randomized Comparative Clinical Study to Evaluate the Longevity of Esthetic Results of Gingival Melanin Depigmentation Treatment Using Different Laser Wavelengths (Diode, CO2, and Er:YAG)
err2020-03-01
err0
PREAI
errSamir Nammour; Marwan El Mobadder; Mélanie Namour; Amaury Namour; Eric Rompen; Elie Maalouf; Aldo Brugnera Junior; Ana Paula Brugnera; Paolo Vescovi; Toni Zeinoun
errShare
errSave
Learning to identify relevant studies for systematic reviews using random forest and external information
err2015-10-23
err55
errOAAI
errKhabsa, Madian; Elmagarmid, Ahmed; Ilyas, Ihab; Hammady, Hossam; Ouzzani, Mourad
errShare
errSave
YAC transgene-mediated olfactory receptor gene choice
err2000-02-01
err0
errOAAI
errFarah A.W. Ebrahimi; James Edmondson; Rodney Rothstein; Andrew Chess
errShare
errSave
researcher View more