Generative AI · Education leadership

Actionable companion · Instructional improvement

From evidence to district action: Can You Help ChatGPT Get an “A” in Organic Chemistry? Teaching Effective Prompting of Large Language Models for Reaction Prediction

AI-assisted editorial implementation guide. The district actions are proposed applications, not findings or recommendations attributed to the original authors. No additional peer review is asserted.

Evidence and context

Confirm the study population, setting and task before applying its findings to your district.

Original authors’ abstract, reproduced under the linked source license:

As generative artificial intelligence (AI) tools such as large language models (LLMs) become widespread, they are increasingly finding applications in chemical sciences. Although LLMs have achieved impressive performance in many chemistry tasks, optimal performance requires proper use, including appropriate prompting techniques. Chemistry students are not generally taught strategies for effective LLM usage, especially for nonwriting tasks. Here we report an activity that introduces organic chemistry students to the use of LLMs such as ChatGPT for predicting the outcome of chemical reactions, specifically the types of alkene addition reactions taught in introductory organic chemistry courses. This activity exposes students to molecular representations, digitization of chemical reactions, train-test splitting practices for evaluating performance, and generalizable LLM prompting strategies, namely, the Five “S” prompt-writing approach and in-context learning. We tested this activity with chemistry students in the USA and in Austria and evaluated the activity through anonymous pre- and postlab surveys. Survey data revealed that students felt that they achieved their learning goals and that the activity was enjoyable. As chemistry students will inevitably interact with LLMs in their future careers, it is important to teach best practices for the effective and critical use of these tools in the context of chemistry.

A 90-day district pilot

  1. Days 1–15 · Appraise. Have the curriculum lead and a teacher read the methods and limitations. Record the study design, sample, comparator, outcomes and evidence gaps. Define a local question that the study can help inform.
  2. Days 16–30 · Design. Choose one instructional unit and a specific teacher-supervised AI use. Compare it with the existing approach using a common learning objective, equivalent tasks and a shared rubric. Name an accountable owner and set the baseline, success threshold and budget before implementation.
  3. Days 31–60 · Test. Start with a small voluntary cohort, preserve an accessible non-AI route and require teacher review. Use synthetic or de-identified examples; approve data handling and tool terms through district processes.
  4. Days 61–90 · Decide. Measure unaided learning on a new task, factual errors, student workload and teacher review time. Disaggregate results where group sizes permit responsible interpretation. Compare with baseline, document uncertainty and stop or revise if learning worsens, access is unequal or critical errors persist.

The board decision brief

Report the learning problem, evidence quality, participating population, total cost including review time, measured benefit, errors, access differences and remaining uncertainties. Make a dated recommendation to stop, revise or expand. A positive perception survey alone does not establish learning improvement.

Attribution and reuse

Elizabeth S. Thrall; Olivia M. Vanden Assem; Julia A. Schneider; Joshua Schrier; Sebastian Tassoti. Can You Help ChatGPT Get an “A” in Organic Chemistry? Teaching Effective Prompting of Large Language Models for Reaction Prediction. Journal of Chemical Education (2026-03-27). https://doi.org/10.1021/acs.jchemed.5c01712

Companion prepared 2026-10-30. Original authorship and DOI are preserved. The abstract is an attributed source extract; the implementation plan is new AI-assisted editorial material, offered under the same CC BY 4.0 license. This guide has not undergone independent peer review.