Actionable companion · Assessment and evidence of learning
From evidence to district action: A Medical Large Language Model-Based System Improves History-Taking Performance Among Medical Students
AI-assisted editorial implementation guide. The district actions are proposed applications, not findings or recommendations attributed to the original authors. No additional peer review is asserted.
Evidence and context
Health-professions education context: test transfer to K–12 rather than assuming it.
Original authors’ abstract, reproduced under the linked source license:
Introduction: To develop a history-taking training and assessment system based on a medical large language model (MedLLM), evaluate its effect on medical students' history-taking competence, and examine its feasibility and effectiveness as a supplement to conventional interview teaching. Methods: An intelligent history-taking training and assessment system was built around a domain-fine-tuned Qwen2.5 large language model. Fifty medical students were assigned in equal numbers to an intervention group and a control group (25 each) using a random number table. The intervention group trained with the system, whereas the control group continued to practice through traditional role-play. Outcomes included system acceptance, practice satisfaction, history-taking examination scores, and agreement between manual and automated scoring. Results: The intervention group rated the system most favorably for feasibility (4.21±0.95) and interest level (3.76±1.14) (P<0.05), and reported significantly greater satisfaction with flexibility (4.06±0.74) and efficiency (4.10±0.60) than the control group (P<0.001). In the manual examination, the intervention group outperformed the control group (84.31±3.92 vs. 80.56±3.41; P<0.05). Overall agreement between automated and manual scoring was good (intraclass correlation coefficient (ICC)=0.76). It was highest for logical organization (ICC=0.87) and clinical reasoning (ICC=0.85) and moderate for communication skills (ICC=0.63) and humanistic care (ICC=0.65). Conclusion: As a useful complement to traditional teaching, the MedLLM-based history-taking training and assessment system provides a flexible and efficient practice platform that meaningfully strengthens students' history-taking ability. Its automated scoring agrees well with manual assessment, indicating strong potential for clinical skills education.
A 90-day district pilot
- Days 1–15 · Appraise. Have the curriculum lead and a teacher read the methods and limitations. Record the study design, sample, comparator, outcomes and evidence gaps. Define a local question that the study can help inform.
- Days 16–30 · Design. Redesign one low-stakes assessment: require a first attempt, an AI-assisted revision, a source-check log and a short oral explanation. Use the same rubric for the comparison task. Name an accountable owner and set the baseline, success threshold and budget before implementation.
- Days 31–60 · Test. Start with a small voluntary cohort, preserve an accessible non-AI route and require teacher review. Use synthetic or de-identified examples; approve data handling and tool terms through district processes.
- Days 61–90 · Decide. Blind-score reasoning, factual accuracy and unaided transfer on a fresh task. Record suspected misconduct separately from demonstrated evidence. Compare with baseline, document uncertainty and stop or revise if learning worsens, access is unequal or critical errors persist.
The board decision brief
Report the learning problem, evidence quality, participating population, total cost including review time, measured benefit, errors, access differences and remaining uncertainties. Make a dated recommendation to stop, revise or expand. A positive perception survey alone does not establish learning improvement.
Attribution and reuse
Yuting Huang; Xin Xiao; Xiaoan Sheng; Chao Wang. A Medical Large Language Model-Based System Improves History-Taking Performance Among Medical Students. Cureus (2026-08-17). https://doi.org/10.7759/cureus.114656
Companion prepared 2026-10-30. Original authorship and DOI are preserved. The abstract is an attributed source extract; the implementation plan is new AI-assisted editorial material, offered under the same CC BY 4.0 license. This guide has not undergone independent peer review.