Implementing chatbots in classrooms for learning English as a foreign language (EFL) has been advocated due to its known advantages for all-level students (Xu & Warschauer, 2020; Yang et al., 2022). It has been reported that interacting with chatbots is beneficial in terms of lowering anxiety, having more speaking opportunities, and thus developing communication skills (Chen et al., 2020; Hwang et al., 2022). Many studies, however, have identified some limitations of chatbots in terms of ultimately cultivating language proficiency (Dizon, 2020; Tai & Chen, 2022). In addition, some aspects of language learning with chatbots are still controversial. For example, there are still differences of opinion about how well chatbots can understand what learners say (Chen et al., 2020) and how designing multimodal chatbots affects the cognitive load of learners (Sweller, 2020).
Multiple studies have pointed out the same flaws and problems with using chatbots, so it's time to take a closer look and figure out which parts of chatbots need to be improved for effective language learning. In this paper, we define chatbots as intellectual conversational agents with whom learners interact for language learning purposes, including Google Assistant and various other independently developed systems. This paper will provide directions for future researchers and teachers who intend to design better language learning experiences by focusing on relatively neglected aspects of chatbots in EFL classrooms.
We conducted a scoping review, analyzing existing literature on the topic, and extracting and charting information (Peters et al., 2022). To begin with, we searched relevant studies in databases including Web of Science, APA PsycINFO, Education Source, and ERIC, using search terms: ‘EFL’, ‘English learning’, ‘chatbot’, and ‘intelligent personal assistant’. We included studies that (1) were published after 2010, (2) adopted an empirical approach, and (3) were written in English. A full-text review of 62 studies was done, and a summary was made using directed content analysis (Hsieh & Shannon, 2005) with the five conceptual foundations for the technology-enhanced learning environment as a guide. We synthesized the issues and limitations suggested in previous studies and provided potential breakthroughs for them, aggregating the ideas partially mentioned in studies scattered in the field. The original framework (Driscoll & Burner, 2021, p. 280) was adapted to reflect the interconnectivity of all foundations (Stenbom et al., 2016).
Figure 1
Five Conceptual Foundations for the Technology-enhanced Learning Environment
In the presented framework, the psychological foundation is concerned with learning theories about how learners interact with technology to acquire and organize knowledge. The novelty effect and learners losing interest in chatbots over time have been constantly reported (Huang et al., 2022). This can also affect learners’ perceptions of chatbots’ human likeness. Girouard-Hallam et al. (2021) observed that learners tend to anthropomorphize chatbots as they gain more knowledge about them. This is undesirable in terms of motivation, as Jeon (2021) noted in some cases, students held a negative attitude toward learning English when they perceived chatbots as machines. If students don’t feel like talking to a human partner, they tend to lose the willingness to communicate. Also, the jokes of chatbots lose appeal over time (Lopatovska, 2020), which calls for a need to build more human-like chatbots. Cultural foundations of the EFL environment play a role here, and Warschauer (2020) reported that ESL preschoolers in the United States perceived chatbots as a mixture between humans and machines. However, Lee and Jeon (2022), and Liu et al. (2022) said that EFL elementary students were more likely to give chatbots human traits. This can be due to the cultural differences between the ESL and EFL environments. Since the EFL environment does not allow much natural use of the target language, students tend to have high levels of anxiety, frustration, and aspiration toward communicating in English, making them more engaged in interacting with chatbots. However, this is not always the case, especially for low-proficiency learners. In terms of pedagogical foundation, many studies repeatedly reported the obstacles low-proficiency learners face when interacting with chatbots: not being able to take more initiative in dialogue (Wu et al., 2020) and adopt different communicative strategies (Chen et al., 2020), but abandon the conversation (Tai & Chen, 2022). It gets even worse when combined with issues from the technological foundations because when chatbots have difficulty understanding learners’ pronunciations, low-proficiency learners usually repeat exactly the same utterance or give up (Chen et Al., 2020). Lastly, although the penetration rate of mobile devices in K-12 schools has largely increased after the pandemic (Goteka, 2022), pragmatic foundations, such as space and time, are still some of the remaining issues to tackle to support language learning through interacting with chatbots.
Four potential solutions emerged from the content analysis. First, chatbots need to provide translations for low-proficiency students. A chatbot being able to communicate in both L1 and L2 is time-saving (Tai, 2022) and decreases students’ cognitive load (Divekar et al., 2018). It also complies with the communicative language teaching approach (Richards, 2005), which allows flexible use of the native language to improve understanding of the target language. Second, using predefined commands for communication can be an adaptive strategy for low-proficiency learners. It helps learners quickly familiarize how chatbots work (Pham et al., 2018) and makes the interface less confusing, which often causes frustration (Moussalli & Cardoso, 2021). Third, designing multimodal feedback is beneficial for low-proficiency learners. It facilitates learners’ connection between aural and written forms of utterances (Lan & Liao, 2018) and lowers the level of anxiety when miscommunication happens (Tai & Chen, 2022). Lastly, various assistive strategies are currently explored in collaboration with chatbots, such as mind maps (Lin & Mubarok, 2021), supportive task design to assure learners’ understanding of chatbots (Dizon, 2020), and integration with social media (Belda-Medina & Calvo-Ferrer, 2022).
Revisiting existing literature and suggesting directions for future studies is especially worthwhile at this point when AECT marks its 100th anniversary this year. In this study, we reflected on previous contributions that have established our fairly positive perspectives on using chatbots in language learning. This study will help future studies incorporate chatbots not repeating the same mistake and designing more holistic language learning experiences.