arrow
Return

Developing a standardized framework for evaluating health apps using natural language processing

delete2025-04-06
delete0
delete
OA
AI
J
Julian Herpertz
B
Bridget Dwyer
J
Jacob Taylor
N
Nils Opel
J
John Torous *
DOI:10.1038/s41598-025-96369-wdelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Despite regulatory efforts, many smartphone health applications remain unregulated, raising concerns about privacy, security, and evidence-based effectiveness. The lack of standardized regulation has led to the proliferation of over 130 frameworks, introducing new criteria and methodologies for app evaluation. The sheer number of frameworks, coupled with their varying approaches to app evaluation, create challenges for comparison. Our study aims to synthesize existing knowledge and propose a standardized app evaluation framework. We conducted a synthesis of reviews on health app evaluation frameworks. Using natural language processing (NLP), we analyzed evaluation domains and grouped them into clusters based on semantic similarities. Standardized definitions for these clusters were developed. We identified eight review articles that met the inclusion criteria, each proposing between six and 17 app evaluation domains. Using NLP, we identified five clusters of app evaluation: Effectiveness & Development, Technology & Functionality, Validity & Legal, Safety & Privacy, and Implementation & Ethics, each of which was assigned a standardized definition. The clusters align with but expand on the American Psychiatric Association's evaluation domains, incorporating critical aspects such as inclusivity, safety, engagement, and ethical principles. Temporal analysis revealed an increasing focus on Effectiveness & Development, while Safety & Privacy showed a stagnation in attention over time.
Keywords:
App evaluation framework
Information management
Mobile health apps
Telemedicine
Natural Language processing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Scientific Reports cover
Scientific Reports
IF:
3.9
Papers:
27.1W
Citations:
83.5W

Organization

F
Friedrich Schiller University of Jena
Scholars:
1.9W
Papers: 1.5W
Citations: 25
H
Harvard University
Scholars:
26.5W
Papers: 22.0W
Citations: 28.7W
H
Harvard Medical School
Scholars:
6.5W
Papers: 4.8W
Citations: 91
researcher View more organizations