Agentic education · Learning science

Actionable companion · Assessment & reasoning

Learning with agency: The contingent impact of artificial intelligence on teaching effectiveness: a meta-analytic review of boundary conditions and moderating factors

AI-assisted editorial implementation guide, separate from the original research. Proposed actions are not claims or recommendations attributed to the source authors. No independent peer review of this guide is asserted.

Read original paperSearch paper agentCC BY 4.0

Evidence and context

Title and abstract screening; stage labels describe reported settings, not verified numerical ages. Design labels require full-text appraisal. Reported stage(s): Age / stage not established. Verify the participant population and task before transferring the findings.

Original authors’ abstract, reproduced under the linked source license:

The digital transformation of education is reshaping pedagogical landscapes and driving the shift toward smart teaching. This meta-analysis examines the impact of Artificial Intelligence (AI)-enabled teaching on intelligent teaching assessment, synthesizing evidence from 35 pre-test-post-test designs and 37 post-test studies. Results show that AI-driven interventions yield significant positive effects, with the post-test effect size (g_p = 0.586) exceeding the pre-test-post-test gain (g_delta = 0.136), primarily due to stricter baseline controls in the latter. Heterogeneity is mainly driven by AI type and results direction, while methodological factors have minor influence. Low publication bias and robust analyses support the reliability of findings, underscoring the importance of appropriate AI application. These insights provide empirical support for reconfiguring teachers’ roles and implementing data-driven instruction, offering strategic guidance for teaching process redesign and the enhancement of teachers’ digital competencies via personalized and adaptive learning.

What kind of evidence is this?

Intelligent tutoring & adaptive learning · Evidence synthesis

Stage: Age / stage not established. Screening labels describe reported context and study-design language. They are not a risk-of-bias rating or proof of effectiveness for an age band.

Limitations and uncertainty · source passage

As a cross-disciplinary field integrating computer science, neuroscience and mathematics, Artificial Intelligence (AI) aims to develop systems that simulate and extend human intelligence. As a key technological force, AI is fundamentally changing the structural conditions of various fields in social production and life. In sectors such as industry, healthcare, transportation, and finance, AI has improved efficiency, service quality, and risk management through automation, diagnostics, routing, and predictive analytics (Bajwa et al., 2021; Fazlollahi et al., 2023; Jing et al., 2018). These applications share core characteristics, such as data-driven decision-making, personalized adaptation, and enhanced efficiency, suggesting that similar AI mechanisms can be transferred to address the unique challenges of education. In the educational ecosystem, AI shows a trend of greater potential for transformation compared to traditional teaching methods. Unlike traditional teaching methods, AI-assisted systems can establish an adaptive learning environment by leveraging interdisciplinary digital resources (i.e., libraries of materials integrating multiple disciplines) and multimodal content (including text, images, videos, and other forms). These systems use a data-driven personalized approach to plan customized learning paths for learners, overcoming the limitations of the “one-size-fits-all” educational model. This means that AI can improve teaching efficiency, promote the transformation of educational forms towards personalization, dynamism, and intelligence, and help establish sustainable personalized learning models to meet the diverse needs of future learners (Chen et al., 2020.).

Design the system before the pilot

Document the learner model, mastery rule, hint sequence and adaptation signal. Compare adaptive routing with the same content in a non-adaptive sequence. Check whether early errors lead to persistent low-expectation pathways.

  • Use common rubrics, blind scoring where feasible and a fresh unaided reasoning task. Document permissible assistance and avoid treating AI-detector scores as proof of misconduct.

A 90-day district pilot

  1. Days 1–15 · Appraise. Have the curriculum lead and a teacher read the methods and limitations. Record the study design, sample, comparator, outcomes and evidence gaps. Define a local question that the study can help inform.
  2. Days 16–30 · Design. Treat the paper as background evidence until its population is verified in the full text. Do not assign an age-specific intervention or extend adult results to children. Name an accountable owner and set the baseline, success threshold and budget before implementation.
  3. Days 31–60 · Test. Start with a small voluntary cohort, preserve an accessible non-AI route and require teacher review. Use synthetic or de-identified examples; approve data handling and tool terms through district processes.
  4. Days 61–90 · Decide. Extract the participant ages or education stage, recruitment, task and comparator before selecting a local pilot. If these cannot be established, retain the paper for design discussion rather than age-band efficacy claims. Compare with baseline, document uncertainty and stop or revise if learning worsens, access is unequal or critical errors persist.

The board decision brief

Report the learning problem, evidence quality, participating population, total cost including review time, measured benefit, errors, access differences and remaining uncertainties. Make a dated recommendation to stop, revise or expand. A positive perception survey alone does not establish learning improvement.

Attribution and reuse

Jie Cai; Jiaqi Zhu; Xinmeng Tang; Guanyi Li. The contingent impact of artificial intelligence on teaching effectiveness: a meta-analytic review of boundary conditions and moderating factors. Frontiers in Psychology (2026-04-29). https://doi.org/10.3389/fpsyg.2026.1744690

Companion prepared 2026-10-30. Original authorship and DOI are preserved. The abstract is an attributed source extract; the implementation plan is new AI-assisted editorial material, offered under the same CC BY 4.0 license. This guide has not undergone independent peer review.