Non-traditional students in accelerated online programs face distinct challenges. Most students work full-time, manage family responsibilities, and pursue education (Tseng et al., 2019; Van Doorn & Van Doorn, 2014) while completing heavier workloads in 7-week courses (Abu-Dawood et al., 2016; Kuo, 2014), risking disengagement or isolation (Roddy et al., 2017; Trespalacios et al., 2021).
AI chatbots have emerged as supportive tools in online learning. Functioning as partners, assistants, and mentors, AI chatbots engage students through dialogue that supports understanding, reflection, and knowledge construction (Goel & Joyner, 2017; Hew et al., 2023; Hyde et al., 2024; Kim et al., 2020; Tamayo et al., 2020; Wollny et al., 2021), providing real-time interaction that helps sustain engagement (Goel & Joyner, 2017; Hyde et al., 2024). Despite these affordances, few studies have examined the use of AI to support non-traditional students in accelerated online courses (Ouyang et al., 2022).
We selected the Poe platform for its free access without requiring paid accounts. Two customized chatbots were developed: one for the Business Orientation course to scaffold research and guide students through online library research, and another for the International Business Management course to serve as a resource partner and support a culminating project. Course-related files and articles were uploaded as the knowledge base, enabling responses grounded in course materials rather than relying solely on general web information.
This study investigates how integrating Poe AI Chatbots (Poe) supports students in Business Orientation and International Business Management courses within an AACSB-accredited Bachelor of Business Administration program by guiding students through research, providing resources, facilitating idea generation, and offering asynchronous support. Three research questions guide this investigation: (1) How do student-generated reflections reveal the research process supported by Poe AI Chatbots? (2) How do student-generated reflections demonstrate student experiences using Poe AI Chatbots? (3) How do student-generated reflections indicate the integrated Poe AI Chatbots' alignment with non-traditional students' needs?
This study draws on secondary data from accelerated online business courses at a northwestern public university in the United States. This study employs qualitative content analysis (Schreier, 2012) to systematically describe the meaning of qualitative material. Data sources include three sets of discussion board posts, two online library research reflections, and four course reflections from three Business Orientation and one International Business Management sessions.
Following Schreier's approach, we used a concept-driven strategy to construct three main categories from the research questions, then applied a data-driven strategy to derive subcategories inductively from reflections. Inductive open coding involved conceptualizing (identifying recurring concepts), defining (grouping concepts into categories), and developing (arranging categories hierarchically). The unit of analysis was each reflection; the unit of coding was the sentence.
Reflections from the three Business Orientation course sessions demonstrated how Poe supported the development of research skills. Students indicated that Poe effectively facilitated the generation, expansion, and refinement of search terms. One student explicitly noted, "The AI chatbot provided search terms I wouldn't have thought of on my own, significantly streamlining my research process." Another highlighted Poe's role in providing foundational knowledge: "I received a lot of helpful ideas, the AI Chatbot really helps get a baseline of knowledge about a topic because you can ask basic questions, but also because you can ask questions that further progress your research." In their discussion and reflection, students emphasized Poe’s capacity to suggest research strategies that reduced irrelevant search results, thereby enhancing research effectiveness.
Student experiences with Poe revealed both affordances and limitations. Students valued Poe for distilling and clarifying complex articles, which helped them understand and annotate key concepts. Nevertheless, students observed quality gaps in the summaries, describing them as “very dry and impersonal" and noting that they sometimes "left out good context." Reliability concerns emerged, as some students worried that the AI "can produce made-up results." They also found some AI responses "a bit generic," prompting requests for "more personalized feedback" and "more detailed responses for course-specific info." Students' prevailing stance reflected cautious optimism, recognizing AI's value while expressing concerns about its reliability. Many described verification behaviors, noting that "you have to double check the sources," while others found that AI-generated summaries confirmed their own thinking and enhanced their confidence.
Students valued Poe for their speed and immediate access to information, but expressed a desire for foundational AI literacy to understand how it works. Even with AI support, students emphasized the reliability of library resources. Some students were curious about comparing different AI tools, while others raised concerns about data privacy. Students articulated a partnership mindset, viewing AI as "meant to work with you and not compete with you," and as a collaborator that complements rather than replaces human thought.
Students described Poe as a helpful resource for understanding coursework and summarizing sources. In the Microsoft Excel module, students highlighted Poe as "very useful in mastering Excel." Students requested deeper integration and frequently relied on the chatbot for quick questions, platform navigation, and minor technical issues. Students noted that the chatbots' immediacy and on-demand access were well-suited to the demanding schedules of non-traditional students, making it "particularly helpful when [students] need[ed] quick clarification on assignments or course concepts." At the same time, students called for more personalized responses to enhance effectiveness and satisfaction.
Student reflections demonstrate Poe's value in supporting research processes among non-traditional students. Educators can leverage AI chatbots as scaffolding tools to help students identify relevant resources and refine research queries, which boosts their confidence in independent research. However, clear guidelines that emphasize the need to evaluate AI-suggested resources are essential for promoting critical evaluation skills.
Students found Poe helpful but recognized the limitations. Concerns about factual reliability and citation accuracy echo findings from existing research (Yang et al., 2025). Students developed conditional knowledge about when and how to use AI effectively, building critical AI literacy. Future implementations should integrate explicit instruction on AI literacy to help students develop skills for evaluating information, maintaining human judgment, and using AI responsibly.
While Poe provided quick clarification and just-in-time support, their responses were sometimes generic and lacked the contextual depth of human feedback. Students preferred greater customization of feedback to better align with their course content and learning needs. Previous research confirms both the potential of AI chatbots to enhance learning and the ongoing challenge of replicating nuanced human interaction (Labadze et al., 2023; Yang et al., 2025). Effective AI chatbot integration depends on balancing response speed, contextual relevance, and human oversight.
Integrating Poe into accelerated online business courses provided meaningful support to non-traditional students, particularly in research and conceptual understanding. However, challenges in reliability, personalization, and trustworthiness highlight the need for careful pedagogical design.
This study did not formally measure academic performance; thus, while students perceived Poe as beneficial to their learning, the direct impact of Poe on learning outcomes remains an open question. Future implementations should incorporate explicit guidelines and targeted AI literacy instruction to optimize the benefits of chatbot use while mitigating potential risks. This study offers evidence on the promise and challenges of AI chatbot integration in accelerated online learning for non-traditional students.