Return
Ontology-driven generation of parameters for health technology assessment models: a prompt engineering study
E
I
J
DOI:10.1017/S0266462326103754.png)
Abstract
En 中文
ObjectivesOntologies support transparent and reproducible conceptual modeling in Health Technology Assessment (HTA); but their population remains resource-intensive and reliant on expert input. This study evaluates the feasibility; reliability; and methodological implications of using generative artificial intelligence (GenAI) to populate ontology individuals for HTA applications.MethodsA factorial experimental framework was developed using the Ontology for Simulation Modeling (OSDi) and three HTA-relevant use cases of varying complexity. Two GenAI systems were evaluated under multiple experimental conditions; including prompting strategy; serialization format; and provision of supporting information. Generated ontology individuals were validated by an HTA expert and assessed across four quality dimensions: consistency; relevance; completeness; and adequacy. Multivariate and regression analyses were conducted to examine the effects of experimental factors on quality outcomes and hallucination likelihood.ResultsGenAI systems successfully generated ontology individuals across use cases; although performance varied by quality dimension and experimental condition. Iterative prompting significantly improved completeness; while serialization format strongly influenced reliability; with Turtle serialization associated with substantially lower hallucination likelihood compared with XML. Other factors showed dimension-specific effects; highlighting the multidimensional nature of ontology quality. Errors occurred more frequently in structurally complex ontology components; suggesting a relationship between ontological complexity and generative performance.ConclusionsGenAI-assisted ontology population can enhance the efficiency and scalability of HTA conceptual modeling; enhancing the agility of HTA agencies in exploratory phases. Its effective use requires structured prompting; appropriate representation formats; and expert validation. Further research should evaluate its impact on HTA decision modeling workflows and validation frameworks.
Keywords:
Ontology Population
Generative Artificial Intelligence
Health Technology Assessment
Economic Evaluation Model
Conceptual Model
Prompt Engineering
Knowledge Synthesis
Automation
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
I
IF:
3.1
Papers:
167
Citations:
0
