EdTech Archives EdTech Archives The Journal of Applied Instructional Design, 15(2)

Teachers in the Loop: Empowering English Language Teachers’ GenAI Functional, Ethical, Rhetorical, and Pedagogical Literacies through Designed Training Modules

Nesma Nasr, Chih-Hsiung Tu, & Laura Sujo-montes

Abstract

This study investigates the impact of GenAI literacy training on language educators’ use of AI for more certain, ethical, and effective integration in classroom practice. For this purpose, the researchers designed ten micro-learning videos based on the UNESCO AI Competency Framework for Teachers and Selber’s Multiliteracies for a Digital Age to strengthen teachers’ functional, ethical, rhetorical, and pedagogical literacies. A mixed-methods design was used. Eighty-two educators from the United States completed the pre-survey, and thirty-four language teachers attended the training and completed both the pre- and post-survey. Data was collected through a pre–post 5-Likert-scale AI literacy survey built on the same frameworks, along with four open-ended questions included in the post-survey. Results indicated statistically significant differences between the overall pre- and post-AI literacy scores and across all four dimensions, suggesting that the training was associated with higher AI literacy levels. Preliminary qualitative results showed enhanced teachers’ confidence and preparedness for ethical and effective GenAI use.

Introduction

The widespread integration of generative AI in education is increasingly framed as nothing short of a paradigm shift, comparable to the disruptive force of industrial revolutions in previous centuries. Unlike earlier educational technology, GenAI is capable of doing creative and intellectual tasks previously thought to be exclusive to humans, such as writing cohesive essays, responding to open-ended inquiries, providing tailored and instant feedback, and developing instructional materials. It also enhances administrative efficiency and affords educators novel instructional design opportunities (Kaufman et al., 2025). Yet ethical challenges and insufficient educator preparedness continue to hinder the responsible incorporation of GenAI in classrooms, underscoring the urgent need for AI literacy (Hossain et al., 2025; Nasr et al., 2025).

Literature Review

English language educators are at the front lines of the AI transformation and urgently need strong GenAI literacy, as the technology is reshaping language learning at a pace that directly influences writing, communication, and meaning-making. No other subject feels this impact as deeply. The affordances are real: students gain access to a tireless, non-judgmental conversational partner and receive immediate textual feedback that stretches practice well beyond scheduled class time (Minnillo et al., 2024). Yet these same affordances generate pedagogical tensions that cannot be bypassed. When AI translates or drafts composition passages replacing the students, the authentic productive struggle that builds their linguistic competence is quietly diminishing, along with the creativity that language learning is meant to cultivate (FengTeng, 2024). Additionally, academic integrity has become a concern; Barrot (2023) coined it “high-tech plagiarism” to capture a form of dishonesty that current detection instruments remain poorly equipped to address. These concerns are further combined by systemic risks, misinformation in model outputs, reproduced bias, and unresolved questions of data privacy and data colonization, each with distinct implications for language classrooms (Hockly, 2023; Nasr et al., 2025).

These risks increase when educators themselves are underprepared. Research has concentrated heavily on learner behavior while leaving largely unexamined how educators conceptualize, direct, and critically evaluate GenAI (Tan et al., 2024; Sperling et al., 2024; Chen, 2024), a gap with tangible consequences for ethical practice, task design, and responsible student guidance (Barrot, 2023; Kohnke et al., 2023; Moorhouse & Kohnke, 2024; FengTeng, 2024; Holmes & Tuomi, 2022). To address this, the present study developed four training modules comprising ten micro-learning videos, each targeting one interrelated dimension of GenAI literacy: functional, ethical, rhetorical, and pedagogical.

Theoretical Perspective

This study uses Media Literacy Theory to explain how individuals access, analyze, evaluate, and create media (Hobbs, 2010). GenAI outputs, texts, images, videos, and prompts, are powerful new media that teachers must analyze, examine, and utilize appropriately. We used Selber's (2004) digital multiliteracies and the UNESCO AI Competency Framework for Teachers (Cukurova & Miao, 2024) to apply this theory in action. Media Literacy Theory explains why teachers must critically evaluate and mold AI-mediated knowledge. Selber and UNESCO supply the what and how, the literacies and development teachers need to use GenAI. Selber provided functional, critical, and rhetorical literacies, whereas UNESCO provided a clear sequence of AI competences (acquire, deepen, create) and responsible pedagogy. We added ethical and pedagogical literacy to Selber's critical literacy to connect the two models for language educators with UNESCO's goal on safe, transparent, and learner-centered AI inclusion. Together, Media Literacy Theory and these two competency models shaped the design of the four GenAI literacy modules and guided the structure of the AI literacy survey used in this study.

The Four GenAI Literacy Modules 

The training has four stages (see Figure 1): First, functional literacy introduces educators to what GenAI is and how it works, its possibilities and limitations, and what teachers should know before using it, so they become informed knowledge creators. Second, the ethical literacy module prepares them to be critical inquirers of AI use. Second, in the ethical literacy module, they become critical inquirers of AI use. They investigate GenAI challenges such as academic integrity, bias, hallucination, privacy, environmental implications, and the double-sided effects on creativity and critical reasoning. This prepares them to reflect on the ethical questions surrounding GenAI and to create a code of ethics for fair, transparent, and responsible use within a human-in-the-loop approach. Research-informed solutions are introduced through the application of critical thinking steps (Figure 2), which connect these systemic risks directly to the realities of individual classrooms. The goal extends beyond problem identification: educators are guided to develop practical, principled responses that position AI as a support structure for human-centered learning rather than a displacement of it. Central to this module is instruction in how to become a collaborative, active AI user. This process follows a four-phase inquiry cycle: educators begin as questioners, initiating dialogue with AI by posing questions; they then explore the AI’s responses by following up with targeted probes and requesting concrete examples; next, they integrate by comparing and contrasting the AI’s claims against prior knowledge and other authoritative sources, actively situating the generated content within the broader disciplinary conversation; finally, they move toward resolution, a reflective moment of synthesis in which they decide how to apply, adapt, or set aside the AI’s contribution, contextualizing it with their own scholarly voice and judgment as the indispensable human in the loop (Nasr et al., 2025).

Figure 1

GenAI Literacy Training Conceptual Framework

A diagram of a diagram

AI-generated content may be incorrect.

Figure 2

Critical Thinking Steps to Use GenAI responsibly and ethically

A diagram of a diagram

AI-generated content may be incorrect.

Note. Adapting the Practical Inquiry Framework to support critical thinking in a GenAI context. Note. Adapted from Garrison et al. (1999) and informed by Nasr et al. (2025).

In the third module, rhetorical literacy (prompt engineering), educators improve their AI prompt writing (see Figure 3) for lesson plans and classroom activities to become reflective producers. Many times, educators’ prompts result in generic outputs that do not meet the unique needs of classrooms or their expectations for the activities. This module prepares them to be reflective users and to develop more effective and contextualized prompts that integrate the rhetorical situation, including writer, audience, tone, purpose, genre, and context. They use the rhetorical triangle, ethos, pathos, and logos, to critically evaluate generated AI content (see Figure 4), resulting in more contextualized and communicative outputs that support a human-in-the-loop approach.

Figure 3

Applying the Rhetorical Situation to Write Effective AI Prompts

A screenshot of a diagram

AI-generated content may be incorrect.

Figure 4

Apply Rhetorical Triangle Strategies for Evaluating the AI-Generated Content

A diagram of a triangle components

AI-generated content may be incorrect.

In the final pedagogical literacy module, educators take on the role of instructional designers who create with AI through the lens of learning theory. They investigate how GenAI tools might enhance learning by creating inclusive and engaging activities. They are also introduced to a variety of effective GenAI tools and implement them to apply strategies that guide learners’ responsible use, diversify teaching approaches, and integrate AI without fostering overreliance. The module further prepares them to evaluate AI’s impact on learning and to propose strategies that promote authentic student assessment in AI-mediated classrooms.

Research Questions

The primary purpose of this study is to examine the impact of the training on language educators' functional, ethical, rhetorical, and pedagogical GenAI literacies necessary for responsible and effective AI use in English teaching contexts. In addition, the study seeks to understand educators’ immediate perceptions after completing the training and how the experience shapes their views of GenAI’s role in classroom practice. To address this aim, the following research questions guided the study:
1. How does GenAI literacy training influence language educators’ GenAI literacy across the four dimensions (functional, ethical, rhetorical, and pedagogical)?
2. What are language educators’ reflections on their experiences and immediate perceptions of GenAI use following the literacy training?

Methodology

This pilot study employs a convergent mixed-methods design. Quantitative data were collected through a pre- and post-training 5-point Likert-scale AI Literacy Survey, which was administered to 82 participants to measure internal reliability. A total of 82 valid responses were analyzed. The internal consistency reliability of the survey was good, with Cronbach’s α = .97. The survey was administered to 34 teachers in the USA who teach English/Humanities/ESL before and after they completed ten micro-learning videos embedded in Canvas within an online course over six weeks. The survey investigated changes across the four literacies, and a paired-samples t-test was used to compare pre- and post-scores. Qualitative data were collected through four open-ended questions in the post-survey and analyzed using thematic analysis (Braun & Clarke, 2006), enabling participants to reflect on their training experience and their immediate perceptions of GenAI in language instruction.

Results

Results indicated a statistically significant difference between the pre- and post-AI literacy survey mean scores, both overall and within each of the four dimensions, suggesting that the AI literacy training positively influenced teachers’ AI literacy levels, as follows:

Table 1

Paired-Samples t-Test Results for GenAI Literacy Dimension (N = 34)

AI Literacy

Dimension

Pre-Training M (SD)

Post-Training M (SD)

t(33)

p

Functional

2.60 (0.72)

4.26 (0.63)

12.36

< .001

Ethical

3.16 (0.88)

4.42 (0.62)

7.62

< .001

Rhetorical

2.73 (0.77)

4.33 (0.61)

11.19

< .001

Pedagogical

2.16 (0.69)

4.30 (0.70)

14.97

< .001

Overall GenAI

Literacy

2.66 (0.74)

4.33 (0.62)

13.32

< .001

Note. All differences are statistically significant. p < .05*, p < .01**, p < .001***

There was a significant increase in overall GenAI literacy from pre-training (M = 2.66, SD = 0.74) to post-training (M = 4.33, SD = 0.62), t(33) = 13.32, p < .001, d = 2.28. This large effect size confirms a substantial development in the educators’ GenAI literacy (see Figure 5), demonstrating the positive impact of the training modules. Also, substantial enhancements were observed across all dimensions of AI literacy: functional (t(33) = 12.36, p < .001, d = 2.12), ethical (t(33) = 7.62, p < .001, d = 1.31), rhetorical (t(33) = 11.19, p < .001, d = 1.92), and pedagogical (t(33) = 14.97, p < .001, d = 2.57).

On the other hand, preliminary qualitative results supported quantitative outcomes, revealing a clear transition from GenAI uncertainty to confidence and competence. Course participants said it transformed their understanding and practical skills. One teacher expressed," I now understand how it can make classes more creative, save time, and let students learn in their own way (Bri). Participants indicated increased AI confidence and ethical awareness, with one stating, “I came into these modules with no knowledge of GenAI, but it helped me grow professionally and become more confident as an educator” (Deid).

Figure 5

Pre- and Post-Training Differences in AI Literacy Dimensions

A graph of a graph with red and green bars

AI-generated content may be incorrect.

Conclusion

What the pilot training demonstrated, above all, is that GenAI literacy is neither an abstract competency nor a self-evident skill; it is something that can be meaningfully cultivated through well-structured learning experiences. Statistically significant gains across all four dimensions, functional, ethical, rhetorical, and pedagogical, confirmed that the training moved educators from positions of uncertainty and limited confidence toward demonstrably stronger understanding and confidence in how to use GenAI ethically and effectively in educational practice. Qualitative findings reinforced this trajectory; participants recognized the modules for their practicality, describing them as making complex AI literacies genuinely comprehensible. These results, however, call for careful interpretation. The sample was small (n = 34), and for a substantial proportion of participants, this may well have been their first sustained encounter with GenAI tools; both factors likely amplified the large effect sizes observed. The fully online delivery format, embedded within a Canvas course over six weeks, may have shaped engagement patterns in ways that a face-to-face or hybrid design would not replicate. Future iterations will recruit a larger, more diverse cohort to assess whether these gains translate into sustained professional development. 

References

  1. Barrot, J. S. (2023). Using ChatGPT for second language writing: Pitfalls and potentials. Assessing Writing, 57, 100745. https://doi.org/10.1016/j.asw.2023.100745
  2. Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative research in psychology, 3(2), 77-101.
  3. Chen, X. (2024). A Phenomenological Study of Teachers' Perception of Professional Development Sessions Focused on Artificial Intelligence: Utilizing the TPACK Framework to Address the Professional Development Needs of Teachers [Doctoral dissertation, Pepperdine University].
  4. Cukurova, M., & Miao, F. (2024). AI competency framework for teachers. UNESCO Publishing.
  5. Feng Teng, M. F. (2024). A systematic review of ChatGPT for English as a foreign language writing: Opportunities, challenges, and recommendations. International Journal of TESOL Studies, 6(3), 36–57. https://doi.org/10.58304/ijts.20240304
  6. Hossain, S., Khanam, S., Haniya, S., & Nasr, N. R. (2025). AI Literacy and LLM Engagement in Higher Education: A Cross-National Quantitative Study. arXiv preprint arXiv:2507.03020.
  7. Hockly, N. (2023). Artificial Intelligence in English Language Teaching: The Good, the Bad and the Ugly. RELC Journal. Advance online publication. https://doi.org/10.1177/00336882231168504
  8. Kaufman, J. H., Woo, A., Eagan, J., Lee, S., & Kassan, E. B. (2025). Uneven adoption of artificial intelligence tools among U.S. teachers and principals in the 2023–2024 school year (RR-A134-25). RAND Corporation. https://doi.org/10.7249/RRA134-25
  9. Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. Relc Journal, 54(2), 537-550. https://doi.org/10.1177/00336882231162868
  10. Minnillo, S., Jones, L., & García, S. (2024). AI in the L2 Classroom: Serving Language Educators through Professional Development. L2 Journal, 16(1), 1–19. https://doi.org/10.5070/L2.21198
  11. Moorhouse, B. L., & Kohnke, L. (2024). The effects of generative AI on initial language teacher education: The perceptions of teacher educators. System, 122, 103290.
  12. Nasr, N. R., Tu, C.-H., Werner, J., Bauer, T., Yen, C.-J., & Sujo-Montes, L. (2025). Exploring the Impact of Generative AI ChatGPT on Critical Thinking in Higher Education: Passive AI-Directed Use or Human–AI Supported Collaboration? Education Sciences, 15(9), 1198. https://doi.org/10.3390/educsci15091198
  13. Selber, S. A. (2004). Multiliteracies for a digital age. SIU Press.
  14. Sperling, K., Stenberg, C. J., McGrath, C., Åkerfeldt, A., Heintz, F., & Stenliden, L. (2024). In search of artificial intelligence (AI) literacy in teacher education: A scoping review. Computers and Education Open, 6, 100169.
  15. Tan, X., Cheng, G., & Ling, M. H. (2025). Artificial intelligence in teaching and teacher professional development: A systematic review. Computers and Education: Artificial Intelligence, 8, 100355. https://doi.org/10.1016/j.caeai.2024.100355