arrow
Return

Evaluation indicator system for AI certificate programs

delete2026-06-22
delete0
delete
OA
AI
Z
Zijing Wu
Q
Qiang Li *
DOI:10.1186/s41239-026-00604-xdelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Despite the rapid proliferation of Artificial Intelligence (AI)certificate programs in higher education, systematic frameworks for evaluating their pedagogical transformation potential remain absent—in contrast to the rich literature on AI tool adoption, which seldom addresses how credentials reshape teaching at the program level—and existing assessments rely on unidimensional methods that overlook both expert judgment and cultural variation. Grounded in the Technological Pedagogical Content Knowledge (TPACK) framework, we employ a hybrid Analytic Hierarchy Process (AHP) and Fuzzy AHP (FAHP) methodology, supplemented by Monte Carlo (MC) simulation (N = 10,000) for robustness verification, drawing on structured pairwise ratings and fuzzy assessments from 18 domain experts across Chinese universities. We identify and prioritize five dimensions—curriculum design, instructional implementation, faculty expertise, technological support, and cross-cultural adaptability—and quantify their relative weights and perceived performance. We find a clear hierarchy in expert priorities: student AI competency achievement (weight = 0.1438, rank stability = 99.8%) and curriculum alignment with AI frontiers (weight = 0.1056, rank stability = 98.5%) emerge as the paramount strategic levers, whereas cross-cultural adaptability receives the lowest weight (0.0735), signaling a technology-first bias in early-stage credential development. Strikingly, faculty professional competence exhibits the largest gap between its perceived importance (weight = 0.1976) and current satisfaction (score = 3.2171)—a finding that challenges the widespread assumption that technological infrastructure is the primary barrier to AI education. By revealing a developmental asymmetry in which content knowledge (CK) outweighs integrated pedagogical capacity, these findings extend TPACK theory into the credential evaluation domain and offer a robust, expert-informed strategic roadmap with explicit guidance for international adaptation.
Keywords:
Artificial Intelligence certificate programs
Higher education transformation
AHP-FAHP hybrid model
TPACK framework
Monte Carlo simulation
Strategic evaluation
China
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of Educational Technology in Higher Education cover
International Journal of Educational Technology in Higher Education
IF:
16.7
Papers:
623
Citations:
5.7K

Organization

G
Guangzhou College of Technology and Business
Scholars:
184
Papers: 132
Citations: 7