EdTech Archives EdTech Archives The Journal of Applied Instructional Design, 14(2)

AI Operational Policy Integration at Top Higher Education Institutions

Zarina Wafula & Naifa Alqahtani

Abstract

This study will provide insight into the distinguishing features of AI implementation at higher education institutions. It focuses on operational dimensions of infrastructure, training, monitoring, evaluation, and supporting AI literacy. While existing literature offers insights into AI's integration in educational settings, specific strategies employed by institutions are underexplored. Through analyzing AI policies in top universities, it will provide an overview of the operational opportunities of AI in higher education institutions that become a part of the ecosystem of modern higher education. By analyzing AI policies and practices in top universities, we can gain insights into how higher education implements AI that shapes the future of teaching and learning in the digital world.

Introduction

The integration of Artificial Intelligence (AI) into higher education has become a significant trend, shaping the future of teaching, learning, and educational management. As AI tools become more accessible, universities face challenges in adopting these technologies responsibly and effectively, particularly regarding the monitoring, evaluation, and training necessary for successful implementation (Chan, 2023). Effective AI adoption requires institutions to prioritize AI literacy for educators, ensuring they are equipped with the knowledge and skills to navigate the rapidly evolving landscape of educational technology (Ng et al., 2021). United Nations Educational Scientific and Cultural Organization guidelines emphasize a human-centered approach to AI integration, promoting ethical, safe, and equitable usage (UNESCO, 2023). Despite growing interest in AI’s potential, research on the specific strategies employed by top universities to incorporate AI into teaching and learning remains limited (Rahman & Watanabe, 2023; Melik & Schmidt-Crawford, 2024). This study aims to explore the current strategies and approaches of top universities in integrating AI into teaching and learning practices, with a focus on their AI policies and the operational challenges they face in fostering AI literacy and effective implementation.The study will examine this question: 

What are top universities' current strategies and approaches to integrate AI into teaching and learning practices?

Monitoring and evaluation of AI

Monitoring and evaluation in education refer to systematic processes of assessing and analyzing various aspects of educational practices, programs, and outcomes to ensure effectiveness and accountability (Stecher et al.; J. H., 2008). Chan (2023) demonstrated that effective monitoring and evaluation mechanisms are essential to gauge the impact and efficacy of AI implementation in educational settings. It also emphasizes the importance of continuous assessment to identify areas for improvement and ensure that AI technologies are employed in a manner that aligns with pedagogical goals and ethical standards.

AI Literacy for Teachers

AI literacy is a fairly recent phenomenon, especially as it relates to education. According to Ng et al., 2021, AI literacy can be defined as knowing the essential functions of AI, applying this knowledge in various scenarios, evaluating/creating with AI applications, and considering human-centered ethical considerations such as fairness, accountability, transparency, and safety. AI literacy is crucial for teachers as it empowers them to navigate the rapidly evolving landscape of educational technology. The operational dimensions of institutions ensure that teachers are active participants in developing and implementing AI technology. By developing AI policies, institutions can ensure that teachers effectively integrate AI tools and resources into their instructional practices, identify opportunities for innovation, and address ethical considerations and biases inherent in AI technologies (Yang et al., 2021).

AI Implementation

While existing research provides insights into the broader dimensions of AI integration and implementation in education (Kaplan-Rakowiski et al., 2023; McKnight & Hicks, 2023; Cardona et al., 2023), there is limited understanding of the specific strategies and approaches employed by universities to integrate AI into teaching and learning practices (Rahman & Watanabe, 2023; Melik & Schmidt-Crawford, 2024). Federspiel et al. (2023) illustrated that the improper use of AI could lead to inequity and ethical issues in the educational setting. Therefore, this research aims to understand how the top 50 universities integrate AI into teaching and learning practices by analyzing their AI policies. The research seeks to provide insight that can inform future AI implementation efforts in educational settings and contribute to the advancement of AI literacy among educators.  

UNESCO policy

United Nations Educational Scientific and Cultural Organization (UNESCO) is a professional international organization with extensive expertise in education. Their guideline for AI and education provides a flexible and adaptable framework focusing on integrating AI emphasizing different aspects.To ensure its ethical, safe, egalitarian, and meaningful usage, the UNESCO guideline for regulating the use of generative AI in education focuses on a variety of actions and regulatory initiatives based on a human-centered perspective. UNESCO recommend that institutions should adopt, revise and fund whole-of-government strategies on AI  (UNESCO., 2023; Chan., 2023). Institutions also can start regulating the use of AI by implementing specific AI ethical regulations. Moreover, they can modify the existing laws that are applicable for regulating AI-generated content.  To do this successfully, institutions can provide detailed regulatory guidelines for generative AI using the existing frameworks and guidelines. 

Challenges in operationalizing AI at universities

Operationalizing artificial intelligence (AI) in higher education, as defined by the UNESCO framework, involves integrating AI technologies into teaching and learning practices with a strong emphasis on two key areas: monitoring and evaluation of AI implementation, and providing training and support for teachers, staff, and students in AI literacy. The monitoring and evaluation of AI implementation in higher education face several significant challenges. To begin with, the complexity of AI systems makes accurate monitoring difficult, as understanding how different algorithms function and their effects on learning outcomes necessitates specialized knowledge and resources that many institutions may lack. Furthermore, the dynamic nature of AI technologies presents an ongoing challenge, as tools and methodologies are continually evolving, requiring institutions to frequently update their curriculum and assessment. Additionally, contextual variability adds complexity to the evaluation process, as the effectiveness of AI tools can differ significantly across various educational contexts, including institutional missions, student demographics, and available resources.

Methodology

A comprehensive review was undertaken, examining the AI policies of the top 25 universities as ranked by US News Top 100 and Times Higher Education. The primary focus of this review will be on how AI is integrated into teaching and learning practices. The study will provide a scrutiny of policies across 25 universities, specifically concentrating on the approaches taken within teaching and learning centers. It will utilize Chan's (2023) Ecological Education Policy. The inclusion criteria for this study was based on policies explicitly addressing AI, with a significant emphasis on operational considerations within teaching and learning centers. These considerations will cover various aspects, including (a) teaching resources, (b) ethics, (c) privacy, (d) student resources, (e) collaboration, (f) monitoring, and (h) the integration of AI systems. By delving into these specific areas, the study aims to provide an understanding of how leading universities navigate the incorporation of AI within their teaching and learning frameworks.

Findings

Institutions are prioritizing the operational dimension. Some universities have created detailed guidelines for generative AI, addressing its educational benefits, limitations, and impact on student learning. Additionally, they have established committees to oversee AI’s educational viability, which provide structured, continuous evaluation to meet institutional standards. These efforts demonstrate a commitment to systematically monitor AI’s role in enhancing teaching and learning, while keeping academic rigor and standards at the forefront.

 Medium sized private institutions have more flexibility in setting AI policies. These institutions emphasize faculty autonomy, allowing educators to decide whether to allow or restrict AI use. For instance, several medium-sized institutions permit instructors to modify their AI policies based on course needs and ethical guidelines. On the other hand, Large public institutions provide more structured policies. They encourage centralized approaches to AI use, offering more defined procedures, especially for academic integrity and privacy protection.

There was some evidence of collaboration among key stakeholders in the integration of generative AI in education, but it was challenging to fully assess the depth and effectiveness of these efforts, as our data was mostly derived from what was publicly available on school websites. In some universities, administrative teams coordinated policy updates to address ethical, technological, and pedagogical developments, and some institutions provided resources for IT departments to manage AI tools'. Additionally, some medium sized universties integrated AI tools, such as Grammarly for use by their students. These collaborative efforts highlight the importance of aligning technological, academic, and administrative priorities to support sustainable AI integration.

All institutions prioritize AI literacy despite differences in the depth and breadth of resources offered. Medium sized institutions focused on providing links for research articles about AI tool usage and ethical guidance, and links for other universities policies and guidance. For instance, these institutions offer AI housekeeping articles, list of professional events, and updates on GAI through podcasts, blogs, and newsletters.  Large public institutions tend to provide more AI literacy programs such  as research centers resources which enhance the use of AI tools. They also encourage cross-institutional collaborations which help reinforce AI readiness.

Institutions demonstrated structured approaches to monitoring and evaluating generative AI implementation. Some developed guidelines that outline AI's benefits, limitations, and impact on learning outcomes. Others established committees to assess AI’s educational feasibility, ensuring integration aligns with academic and institutional goals. Additionally, policies were reassessed to provide guidance on incorporating AI into assignments and assessments while maintaining academic integrity. These efforts underscore the importance of continuous evaluation in responsibly integrating AI into education.

All institutions had operational policies guiding the ethical use of AI in education. Large and medium-sized universities created policies that allowed educators to define how AI tools should be used, setting clear parameters for academic integrity and ethical AI usage. Some institutions encouraged educators to design assignments that discourage academic dishonesty while integrating AI, fostering responsible engagement with technology. Additionally, large universities recommended against using AI detection software, advocating for a more nuanced approach to AI integration. These highlight that universities' policy implementation and approaches to AI integration vary significantly when it comes to ethics.

Discussion

Divergence in policy approach reflects variations in institutional governance. The AI policy’s flexible implementation allows institutions to prioritize faculty autonomy (Hadley, 2022). It enables instructors to adapt AI based on specific course needs and ethical standards. In addition, it promotes fostering innovation, allowing educators to explore AI applications in diverse pedagogical contexts. In contrast, some institutions adopt more structured and centralized AI policies emphasizing consistency (Cihon et al., 2020). This approach reflects the institutions’ accountability requirements, especially in academic integrity and privacy protection

Institutions’ training is a priority across institutions of all sizes, aligning with the flexibility seen in their policy implementation, supports educators as they navigate the integration of AI into diverse instructional settings. In addition, the comprehensive training that some large institutions provide ensures that staff and students are well-prepared for AI-driven educational environments (Magrill & Magrill, 2024). AI literacy is another shared priority across institutions. It keeps faculty and students informed on the latest developments in AI tools and ethical considerations. Enhancing AI literacy boosts AI culture readiness and knowledge sharing, which in return promotes AI operation strategies in the institution (Korte et al., 2024, Olari et al., 2022). This variation of AI literacy initiatives demonstrates that size, resources, and governance structures greatly influence each institution. 

Conclusion 

The integration of AI in higher education requires robust operational policies focused on monitoring and evaluation to address the technical, ethical, and pedagogical challenges that institutions face. Key obstacles include inadequate training and support, limited access to technology, infrastructure issues, time constraints, and resistance to change (Youssef Abou Karroum & Elshaiekh, 2023). To address these issues, Chan (2023) proposes an AI Ecological Education Policy Framework with pedagogical, governance, and operational dimensions. This framework aims to improve teaching and learning outcomes while addressing privacy, security, and infrastructure concerns. As AI adoption increases, the roles of teachers and educational leaders are expected to evolve (Begum, 2024). To successfully harness AI's potential, institutions must work collaboratively with stakeholders to facilitate implementation through knowledge, funding, and support structures that promote responsible AI adoption. Institutions should create clear, structured policies outlining AI Policies while enhancing the AI literacy in their classrooms. These AI policies should be created by a group of various members, such as faculty, administrators, IT experts, and student representatives, to be comprehensive. 

References

  1. Begum, I. U. (2024). Role of Artificial Intelligence in Higher Education- An Empirical Investigation. International Research Journal on Advanced Engineering and Management (IRJAEM), 2(03), 49–53. https://doi.org/10.47392/IRJAEM.2024.0009
  2. Cardona, M. A., Rodríguez, R. J., & Ishmael, K. (2023). Artificial intelligence and the future of teaching and learning. Office of Educational Technology. https://tech.ed.gov/files/2023/05/ai-future-of-teaching-and-learning-report.pdf
  3. Chan, C. K. Y., & Lee, K. K. W. (2023). The AI generation gap: Are Gen Z students more interested in adopting generative AI such as ChatGPT in teaching and learning than their Gen X and Millennial Generation teachers? arxiv: 2305. 02878
  4. Chan, C. K. Y., & Tsi, L. H. Y. (2023). The AI Revolution in Education: Will AI Replace or Assist Teachers in Higher Education? [Preprint]. arxiv: 2305. 01185
  5. Chan, C. K. Y. (2023). A comprehensive AI policy education framework for university teaching and learning. International Journal of Educational Technology in Higher Education, 20(1), 38. https://doi.org/10.1186/s41239-023-00408-3
  6. Cihon, P.J., Maas, M.M., & Kemp, L. (2020). Should Artificial Intelligence Governance be Centralised?: Design Lessons from History. Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society. https://doi.org/10.1145/3375627.3375857
  7. Feldstein, S. (2019). The road to digital unfreedom: How artificial intelligence is reshaping repression. Journal of Democracy, 30(1), 40–52. https:// doi. org/ 10. 1353/ jod. 2019. 0003
  8. Federspiel, F., Mitchell, R., Asokan, A., Umana, C., & McCoy, D. (2023). Threats by artificial intelligence to human health and human existence. BMJ Global Health, 8(5), e010435. https:// doi. org/ 10. 1136/ bmjgh- 2022- 010435
  9. Gellai, D. B. (2022). Enterprising academics: Heterarchical policy networks for artificial intelligence in British higher education. ECNU Review of Education. https:// doi. org/ 10. 1177/ 20965 31122 11437 98
  10. Hadley, E.C. (2022). Prioritizing Policies for Furthering Responsible Artificial Intelligence in the United States. 2022 IEEE International Conference on Big Data (Big Data), 5029-5038.  https://doi.org/10.1109/BigData55660.2022.10020551
  11. Kaplan-Rakowski, R., Grotewold, K., Hartwick, P., & Papin, K. (2023). Generative AI and Teachers’ Perspectives on Its Implementation in Education. Journal of Interactive Learning Research, 34(2), 313-338.
  12. Karroum, S. Y. A., & Elshaiekh, N. E. M. (2023). Digital Transformation in Education: Discovering the Barriers that Prevent Teachers from Adopting Emerging Technologies. 2023 24th International Arab Conference on Information Technology (ACIT), 1–5. https://doi.org/10.1109/ACIT58888.2023.10453908
  13. Korte, S., Cheung, W.M., Maasilta, M., Kong, S., Keskitalo, P., Wang, L., Lau, C., Lee, J.C., & Gu, M.M. (2024). Enhancing Artificial Intelligence Literacy Through Cross-Cultural Online Workshops. Computers and Education Open. https://doi.org/10.1016/j.caeo.2024.100164
  14. Magrill, J., & Magrill, B. (2024). Preparing Educators and Students at Higher Education Institutions for an AI-Driven World. Teaching and Learning Inquiry.  https://doi.org/10.20343/teachlearninqu.12.16
  15. McKnight, L. and Hicks, T. (2023). Generative AI Writing Tools: How They Work, What They Do, and Why They Matter. In R. E. Ferdig, R. Hartshorne, R., E. Baumgartner, R. Kaplan-Rakowski, and C. Mouza (Eds). What preK–12 teachers should know about educational technology in 2023: A research-to-practice anthology. (pp. 117-121). Association for the Advancement of Computing in Education (AACE). https://www.learntechlib.org/p/222690/
  16. Melek, Z., & Schmidt-Crawford, D. (2024). GenAI in Teacher Education: Teacher Educators' Views on AI in Pre-service Teacher Education. In Proceedings of the Society for Information Technology and Teacher Education Conference.
  17. Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021). Conceptualizing AI literacy: An exploratory review. Computers and Education https://doi.org/10.1016/j.caeai.2021.100041.
  18. Olari, V., Tenório, K., & Romeike, R. (2022). Introducing Artificial Intelligence Literacy in Schools: A Review of Competence Areas, Pedagogical Approaches, Contexts and Formats. IFIP World Conference on Computers in Education. https://doi.org/10.1007/978-3-031-43393-1_21
  19. Rahman, M. M., & Watanobe, Y. (2023). Chatgpt for education and research: Opportunities, threats, and strategies. Applied Sciences, 13(9), 5783. https://doi.org/10.3390/app13095783
  20. Stecher, B., & Stronge, J. H. (2008). Reader's guide to educational research. Thousand Oaks, CA: Corwin.
  21. Tarisayi, K. S. (2024). Strategic leadership for responsible artificial intelligence adoption in higher education. CTE Workshop Proceedings, 11, 4–14. https://doi.org/10.55056/cte.616
  22. UNESCO. (2021a). AI and education: Guidance for policy-makers. 
  23. UNESCO. UNESCO. (2021b). Recommendations on the Ethics of Artificial Intelligence. 
  24. UNESCO. UNESCO (2023). Ethics of Artificial Intelligence. Retrieved from https:// www. unesco. org/ en/ artifi cial- intel ligen ce/ recom menda tion- ethics
  25. Venkateswaran, P. S., Ayasrah, F. T. M., Nomula, V. K., Paramasivan, P., Anand, P., & Bogeshwaran, K. (2024). Applications of artificial intelligence tools in higher education. In Data-Driven Decision Making for Long-Term Business Success (pp. 124-136). IGI Global.
  26. Yang, S. J. H., Ogata, H., Matsui, T., & Chen, N. S. (2021). Human-centered artificial intelligence in education: Seeing the invisible through the visible. Computers and Education https://doi.org/10.1016/j.caeai.2021.100008.
  27. Yau, S., Chai, C. S., Chiu, T. K. F., Meng, H., King, I., & Yam, Y. (2022). A phenomenographic approach on teacher conceptions of teaching artificial intelligence (AI) in K-12 schools. Education and Information Technologies, 28, 1041– 1064. https://doi.org/10.1007/s10639-022-11161-x