Actionable companion · Motivation & engagement
Learning with agency: Whether and When Could Generative AI Improve College Student Learning Engagement?
AI-assisted editorial implementation guide, separate from the original research. Proposed actions are not claims or recommendations attributed to the source authors. No independent peer review of this guide is asserted.
Evidence and context
Title and abstract screening; stage labels describe reported settings, not verified numerical ages. Design labels require full-text appraisal. Reported stage(s): Higher education. Verify the participant population and task before transferring the findings.
Original authors’ abstract, reproduced under the linked source license:
Abstract Generative AI (GenAI) technologies have been widely adopted by college students since the launch of ChatGPT in late 2022. While the debate about GenAI’s role in higher education continues, there is a lack of empirical evidence regarding whether and when these technologies can improve the learning experience for college students. This study utilizes data from a survey of 72,615 undergraduate students across 25 universities and colleges in China to explore the relationships between GenAI use and student learning engagement in different learning environments. The findings reveal that over sixty percent of Chinese college students use GenAI technologies in Academic Year 2023–2024, with academic use exceeding daily use. GenAI use in academic tasks is related to more cognitive and emotional engagement, though it may also reduce active learning activities and learning motivation. Furthermore, this study highlights that the role of GenAI varies across learning environments. The positive associations of GenAI and student engagement are most prominent for students in “high-challenge and high-support” learning contexts, while GenAI use is mostly negatively associated with student engagement in “low-challenge, high-support” courses. These findings suggest that while GenAI plays a valuable role in the learning process for college students, its effectiveness is fundamentally conditioned by the instructional design of human teachers. Keywords: generative AI, effective teaching practices, college student learning engagement
What kind of evidence is this?
Supporting AI learning science · Survey / observational study
Stage: Higher education. Screening labels describe reported context and study-design language. They are not a risk-of-bias rating or proof of effectiveness for an age band.
Study methods · source passage
This study uses data from the 2024 China College Student Survey, which focused on student engagement in college. The sample consists of undergraduate students from 24 universities and colleges who volunteered to participate in CCSS, including 11 Double World-Class (DWC) higher education institutions (HEIs)1 and 14 non-elite ones. Stratified random sampling was used in each institution to draw participants. The valid returned sample contains 72,615 students with an average response rate of 70.76%. Table 1 presents the detailed characteristics of the valid sample.
Limitations and uncertainty · source passage
It is important to acknowledge the limitations of this study. The sample contains more elite universities, potentially limiting the generalizability of our findings to the broader student population. The over-representation may lead to overestimation of both the prevalence and impact of GenAI use, as students in elite universities might be more engaged with emerging technologies compared with their peers at less-resourced institutions. In addition, the self-selection of GenAI users may introduce endogeneity, as students who choose to use GenAI may differ systematically in their motivation, aptitude, or digital literacy. Therefore, the findings of the current study could not be interpreted as causal relationships. Future studies should adopt experimental or quasi-experimental designs and longitudinal data to more robustly identify causal effects over time, and expand sampling to encompass a broader spectrum of institutions. Furthermore, the study is limited to China. While we believe the core findings may have some universal relevance, the absence of international comparative data limits our ability to contextualize our findings within the global landscape.
Design the system before the pilot
Use this study to inform a learning mechanism or implementation question. It is not direct evidence that autonomous agents improve learning. Keep the proposed agent behavior separate from what the source actually tested.
- Measure engagement separately from achievement. Check whether novelty-driven participation persists and whether it translates to independent performance.
A 90-day district pilot
- Days 1–15 · Appraise. Have the curriculum lead and a teacher read the methods and limitations. Record the study design, sample, comparator, outcomes and evidence gaps. Define a local question that the study can help inform.
- Days 16–30 · Design. Choose one disciplinary task. Require a first attempt, a documented AI consultation, a critique of the output and an independent explanation. Align the comparison group and scoring rubric with the same objective. Name an accountable owner and set the baseline, success threshold and budget before implementation.
- Days 31–60 · Test. Start with a small voluntary cohort, preserve an accessible non-AI route and require teacher review. Use synthetic or de-identified examples; approve data handling and tool terms through district processes.
- Days 61–90 · Decide. Blind-score reasoning and accuracy on a new task without AI. Distinguish model examination scores, student perceptions and actual learner gains; only the last directly tests educational benefit. Compare with baseline, document uncertainty and stop or revise if learning worsens, access is unequal or critical errors persist.
The board decision brief
Report the learning problem, evidence quality, participating population, total cost including review time, measured benefit, errors, access differences and remaining uncertainties. Make a dated recommendation to stop, revise or expand. A positive perception survey alone does not establish learning improvement.
Attribution and reuse
Fei Guo; Lanwen Zhang; Tianle Shi; Hamish Coates. Whether and When Could Generative AI Improve College Student Learning Engagement?. Behavioral Sciences (2025-07-25). https://doi.org/10.3390/bs15081011
Companion prepared 2026-10-30. Original authorship and DOI are preserved. The abstract is an attributed source extract; the implementation plan is new AI-assisted editorial material, offered under the same CC BY 4.0 license. This guide has not undergone independent peer review.