Actionable companion · Assessment & reasoning

From AI evidence to responsible practice: Effectiveness of AI-enhanced virtual patients for psychiatric interview training in health professions education: a meta-analysis

AI-assisted editorial implementation guide, separate from the original research. Proposed actions are not findings or recommendations attributed to the source authors. No independent peer review of this guide is asserted.

Read original paper Search paper agent CC BY 4.0

Evidence and context

Title and abstract screening; stage labels describe reported settings, not verified numerical ages. Design labels require full-text appraisal. Reported stage(s): Higher education. Verify the participants, intervention and comparator before applying this study in a new setting.

Original authors’ abstract, reproduced under the linked source license:

Abstract Objectives Artificial intelligence (AI)–enhanced virtual patient simulations are increasingly used in health professions education to improve clinical communication and diagnostic reasoning. However, the effectiveness of these technologies for psychiatric interview training has not been systematically quantified. This study aimed to systematically review and meta-analyze the existing literature evaluating the impact of AI-enhanced virtual patients on psychiatric interview performance, knowledge acquisition, and learner confidence in health professions education. Materials and methods A systematic review and meta-analysis was conducted following the PRISMA 2020 guidelines. Electronic database searches were performed in PubMed/MEDLINE, Scopus, Web of Science, and Google Scholar to identify relevant studies published between January 2000 and March 2026. Studies were included if they evaluated AI-enhanced virtual patient simulations for psychiatric interview training among medical students, psychiatry residents, clinicians, or other health professions trainees. Data extraction included study characteristics, participant populations, intervention types, and educational outcomes. Risk of bias was assessed using the Cochrane Risk of Bias Tool. Quantitative synthesis was performed using random-effects meta-analysis models, and effect sizes were calculated as standardized mean differences (SMD) with 95% confidence intervals (CI) using R statistical software. Results A total of 560 records were identified through database searches and additional sources. After removal of duplicates and screening procedures, 10 studies met the inclusion criteria and were included in the final analysis. The studies involved approximately 450 participants, including medical students, psychiatry residents, clinicians, nursing students, and psychology trainees. AI-enhanced virtual patient interventions included conversational AI systems, virtual human simulations, large language model–based simulated patients, and AI–virtual reality training environments. The pooled analyses indicated improvements in psychiatric interview performance, knowledge acquisition, and learner confidence following AI-supported virtual patient training. Subgroup analysis demonstrated positive educational outcomes across both student and clinician populations. Risk-of-bias assessment revealed variable methodological quality across studies, with several pilot and non-randomized designs. Conclusion AI-enhanced virtual patient simulations appear to be effective educational tools for improving psychiatric interview training in health professions education. These technologies provide scalable and standardized simulation environments that support communication skill development, diagnostic reasoning, and learner confidence. Although the findings suggest promising educational benefits, further large-scale randomized controlled trials and standardized outcome assessments are needed to confirm the long-term educational impact of AI-supported virtual patient training in psychiatry. Keywords: artificial intelligence, clinical communication skills, health professions education, medical education, meta-analysis, psychiatric interview training, simulation-based learning, virtual patients

What kind of evidence is this?

Supporting AI learning science · Evidence synthesis

Stage: Higher education. Screening labels describe reported context and study-design language. They are not a risk-of-bias rating or proof of effectiveness for an age band.

Study methods · source passage

This study was conducted as a systematic review and meta-analysis to evaluate the effectiveness of AI-enhanced virtual patients for psychiatric interview training in health professions education. The study design followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA 2020) guidelines to ensure transparency and reproducibility in study identification, screening, and reporting (26). The methodological framework was also informed by recommendations for meta-analysis in health professions education research (27).

Limitations and uncertainty · source passage

The increasing integration of artificial intelligence and large language models into simulation platforms represents an important advancement in medical education technology. Traditional virtual patient systems often rely on pre-programmed scripts or branching narratives, which can limit the realism of patient interactions. In contrast, AI-driven conversational agents are capable of generating dynamic responses and adapting to learner input during simulated interviews. Pedrajas et al. demonstrated that ChatGPT-based simulated patients could effectively support clinical training in psychology by enabling realistic interview interactions and diagnostic reasoning exercises (23). García-Torres et al. reported that AI-based virtual simulated patients allowed learners to practice psychopathological interviews in a flexible and interactive environment (24). These developments suggest that AI-driven simulations may overcome some of the limitations associated with earlier rule-based virtual patient systems.

Design the system before the pilot

Use this study to inform a learning mechanism or implementation question. It is not direct evidence that autonomous agents improve learning. Keep the proposed agent behavior separate from what the source actually tested.

Use common rubrics, blind scoring where feasible and a fresh unaided reasoning task. Document permissible assistance and avoid treating AI-detector scores as proof of misconduct.
Co-design accommodations with learners and specialists. Check access and error burden across groups without inferring subgroup effectiveness from small or unreported samples.

A 90-day district pilot

Days 1–15 · Appraise. Have the curriculum lead and a teacher read the methods and limitations. Record the study design, sample, comparator, outcomes and evidence gaps. Define a local question that the study can help inform.
Days 16–30 · Design. Choose one disciplinary task. Require a first attempt, a documented AI consultation, a critique of the output and an independent explanation. Align the comparison group and scoring rubric with the same objective. Name an accountable owner and set the baseline, success threshold and budget before implementation.
Days 31–60 · Test. Start with a small voluntary cohort, preserve an accessible non-AI route and require teacher review. Use synthetic or de-identified examples; approve data handling and tool terms through district processes.
Days 61–90 · Decide. Blind-score reasoning and accuracy on a new task without AI. Distinguish model examination scores, student perceptions and actual learner gains; only the last directly tests educational benefit. Compare with baseline, document uncertainty and stop or revise if learning worsens, access is unequal or critical errors persist.

The board decision brief

Report the learning problem, evidence quality, participating population, total cost including review time, measured benefit, errors, access differences and remaining uncertainties. Make a dated recommendation to stop, revise or expand. A positive perception survey alone does not establish learning improvement.

Attribution and reuse

Senay Kilincel; Furkan Bulut; Pelin Goksel; Mirac Baris Usta; Tuba Mutluer; Oguzhan Kilincel. Effectiveness of AI-enhanced virtual patients for psychiatric interview training in health professions education: a meta-analysis. Frontiers in Medicine (2026-05-14). https://doi.org/10.3389/fmed.2026.1834636

Companion prepared 2026-11-01. Original authorship and DOI are preserved. The abstract is an attributed source extract; the implementation plan is new AI-assisted editorial material, offered under the same CC BY 4.0 license. This guide has not undergone independent peer review.