We aim to investigate the perceived benefits and challenges of using ChatGPT as a conversational AI tool in educational settings. We will explore how ChatGPT influences student engagement and learning outcomes in education. Additionally, we aim to identify the ethical considerations and safeguards that should be implemented when deploying ChatGPT in educational contexts. Furthermore, we will examine how the integration of ChatGPT affects the role of educators and the teaching-learning process. By addressing these research questions, we seek to understand the impact and implications of incorporating ChatGPT into educational environments.

The Populations, Interventions, Comparators, Outcomes, and Study Designs (PICOS) framework for our systematic review is outlined as follows:

The search method utilized in this survey can be described in detail as follows:

After applying the search criteria, we obtained a list of approximately 729 publications. However, we conducted a rigorous screening process to retain only the relevant articles, resulting in a final selection of 70 papers published between 2022 and 2023. The following outlines the steps involved in the filtration and selection process:

Table 2 shows the criteria used during the inclusion and exclusion phases.

Quality Assessment Rules (QARs) were utilized to assess the obtained articles’ suitability in addressing the study questions. A set of 10 QARs was created, with each rule assigned a maximum score of 1 out of 10. The scoring was based on the following formula: “completely responded” = 1, “above average” = 0.75, “average” = 0.5, “below average” = 0.25, and “not answered” = 0. The article’s overall score was calculated by summing the points obtained from all 10 QARs. If the total score was five or above, the article was deemed acceptable; otherwise, it was excluded. The selected research articles and their respective QAR scores can be found in Table 9 in Appendix A.

The compiled list of articles was the basis for extracting the relevant information to address the research questions. Each article’s title, publication year, publication type, publisher source, description, keywords, paper theme related to RQ1, limitations associated with RQ2, advantages/opportunities associated with RQ3, and recommendations related to RQ4 were among the data retrieved from each paper. However, it is essential to note that not all articles addressed all the research questions.

The extracted data for each research question were synthesized to analyze and summarize the findings related to paper themes, limitations, advantages, and recommendations. For RQ1, the paper themes were identified by categorizing the main topics explored in each publication. RQ2 involved examining the limitations mentioned in the articles to identify common challenges or shortcomings associated with using ChatGPT in education. In addressing RQ3, the advantages or opportunities of using ChatGPT in education were synthesized to understand the positive impacts and potential benefits. For RQ4, recommendations were gathered, combining qualitative insights and quantitative data, to provide practical suggestions for deploying and implementing ChatGPT in educational settings. Synthesis of this data gave a comprehensive understanding of the paper’s themes, limitations, advantages, and recommendations concerning ChatGPT’s use in education.

In this RQ, we aim to investigate the benefits and challenges of using ChatGPT, which researchers have widely studied. After reviewing each selected research article and analyzing it, we plotted a bar chart of the frequency of each benefit and challenge we found in each paper, represented in Figures 5, 6. According to Figure 5, based on the analysis of the selected research articles, the most frequent benefit identified in the papers is that ChatGPT enhances learning. This indicates that researchers have found evidence suggesting that using ChatGPT in various applications positively impacts learning (Kasneci et al., 2023). This benefit could refer to how ChatGPT can be used as a virtual tutor or assistant to provide users with personalized and interactive learning experiences (Hopkins et al., 2023). Another benefit often associated with using ChatGPT, which could be included in the analysis, is improved access to information. ChatGPT can act as a conversational interface, allowing users to ask questions and receive relevant information quickly and conveniently.

With ChatGPT, users can access a wide range of information without the need to navigate through complex interfaces or conduct extensive searches (O’Connor and ChatGPT, 2023). The conversational nature of ChatGPT allows for natural language queries, making it easier for users to express their information needs and obtain the desired information more conversationally and interactively. Additionally, ChatGPT can be integrated with various data sources and APIs, enabling it to retrieve real-time information or access specific databases. This can be particularly beneficial in domains where up-to-date information is crucial, such as news, weather updates, etc.

Overall, improved access to information is a significant advantage of ChatGPT, as it simplifies retrieving data and enables users to obtain relevant answers more efficiently.

According to Figure 6, which represents the frequency of challenges associated with ChatGPT, it is observed that the most common challenges identified in the research articles are:

ChatGPT faces several challenges that must be addressed to improve its performance and ethical considerations. One such challenge is the presence of biases in AI models, including ChatGPT. Language models are trained on vast amounts of text data, which may inadvertently contain tendencies in the data sources. These biases can lead to unfair or discriminatory responses generated by ChatGPT. Addressing biases requires careful data curation, identification, and mitigation techniques to ensure fairness and inclusivity in the AI model’s responses.

Another significant challenge is the need for more accuracy in ChatGPT’s responses. While language models generate text based on patterns observed in their training data, they need proper understanding or knowledge. Consequently, they may need accurate or correct information in certain situations. Achieving higher accuracy involves advancing training methodologies, accessing reliable and diverse datasets, and developing mechanisms to verify and fact-check the data generated by ChatGPT (Ahn, 2023).

The lack of emotional intelligence is another challenge for ChatGPT. It may need help understanding and appropriately responding to emotional cues expressed during conversations. Emotions play a vital role in human communication, and the absence of emotional intelligence in ChatGPT hinders its ability to provide sensitive responses. Enhancing emotional intelligence requires incorporating affective computing techniques, sentiment analysis, and the capability to recognize and respond to users’ emotional states.

Additionally, ChatGPT models often lack critical thinking abilities. While they can generate coherent responses, they may need help with complex queries requiring deeper analysis, reasoning, or inference. Advancing essential thinking capabilities involves exploring techniques such as knowledge incorporation, logical reasoning, and the ability to handle abstract or ambiguous queries (Zielinski et al., 2023) effectively.

Ethical considerations are a multifaceted challenge when using ChatGPT. Transparency ensures users know they interact with an AI system and understand its limitations and capabilities. Accountability involves addressing responsible development, deployment, and use of AI models like ChatGPT. Safeguarding user privacy and data protection is essential for maintaining user trust. Additionally, measures must be in place to prevent the malicious use of biased applications of ChatGPT.

Addressing these challenges requires collaborative efforts from researchers across various disciplines, including AI, ethics, psychology, linguistics, and more. It involves refining model architectures, improving training methodologies, incorporating external knowledge sources, developing robust evaluation metrics, and implementing guidelines and regulations for responsible AI development and deployment.

By actively working on these challenges, researchers aim to enhance the benefits of ChatGPT while mitigating its limitations. This approach paves the way for more reliable, accurate, and ethically conscious conversational AI systems.

The use of ChatGPT in education has the potential to influence student engagement and learning outcomes greatly. By analyzing the provided paragraph and considering the available literature, it becomes evident that ChatGPT’s advanced capabilities contribute to enhanced educational experiences. One significant factor is the program’s ability to provide personalized student interaction. Through tailored responses and prompt feedback, ChatGPT creates an interactive learning environment that captures students’ attention and encourages active participation (Looi, 2023).

Moreover, ChatGPT’s extensive knowledge base allows it to quickly generate accurate and relevant information. This accessibility to a wide range of knowledge empowers students to explore diverse perspectives and engage in critical thinking. ChatGPT supports students in understanding complex concepts by providing comprehensive and up-to-date information, thereby improving their learning outcomes.

Furthermore, ChatGPT’s availability and quick response time significantly impact student engagement (Zielinski et al., 2023). Unlike traditional methods, where students may need to search for information through web browsing or rely on human assistance, ChatGPT provides immediate answers and guidance. This convenience saves time and keeps students actively engaged in learning, as they can access information whenever needed.

However, it is crucial to acknowledge the limitations and challenges associated with using ChatGPT in education. At the same time, the program’s impressive capabilities should be seen as a partial substitute for human educators. The importance of human interaction, guidance, and mentorship must be supported. Maintaining a balance between AI and human involvement is essential to ensure a holistic learning experience that addresses academic and socio-emotional needs.

Furthermore, the accuracy and reliability of the information generated by ChatGPT should be carefully considered. As with any AI system, “garbage in, garbage out” applies. If the program is trained on inaccurate or biased data, it may produce misleading or incorrect information (Ahn, 2023). Therefore, it is crucial to validate and verify the information provided by ChatGPT through reputable sources and critical analysis.

In conclusion, the use of ChatGPT in education has the potential to influence student engagement and learning outcomes positively. Its personalized interaction, prompt responses, and access to a wide range of knowledge contribute to an enriched learning experience. However, it is essential to balance AI and human involvement and critically evaluate the information provided by ChatGPT. By harnessing AI’s power while embracing human educators’ invaluable role, we can create a learning environment that maximizes student engagement and fosters meaningful learning outcomes. Based on the selected articles, we categorized the factors previously discussed and presented them in Table 3. Table 3 summarizes the main points discussed in the paragraph, highlighting the factors influencing student engagement and learning outcomes when using ChatGPT in education.

When deploying ChatGPT or similar AI chatbots in educational contexts, it is crucial to establish a comprehensive framework of ethical considerations and safeguards to ensure responsible and beneficial use. Clear guidelines and policies should be developed to outline the appropriate use of AI-generated content, including any limitations or restrictions. This helps establish a standardized approach to the deployment of ChatGPT and ensures that its use aligns with ethical principles.

Human supervision plays a vital role in the responsible deployment of ChatGPT. Teachers or educators should be actively involved in the process (Huang et al., 2023), providing guidance and oversight to ensure the accuracy and integrity of the content generated by the AI chatbot. Their involvement helps prevent the dissemination of misinformation or biased information, as they can intervene when necessary and provide additional context or clarification to the students.

Proper training and awareness programs should be provided to teachers and educators using ChatGPT. They should be familiarized with the capabilities and limitations of the AI chatbot and trained to understand the potential biases (Khan et al., 2023) and errors that can arise from AI-generated content. By being well-informed, they can effectively utilize the tool and address ethical concerns.

Encouraging critical thinking and evaluation skills among students is crucial when utilizing ChatGPT in an educational context. Students should be taught to approach the information generated by the AI chatbot with a discerning mindset, questioning and verifying its accuracy through independent research and analysis. This empowers them to develop critical thinking skills and avoid mindlessly accepting information provided by AI systems.

Privacy and data protection should be paramount when deploying ChatGPT in an educational setting. Educational institutions must prioritize students’ privacy and ensure their personal information is securely stored and protected. Data encryption, access controls, and compliance with relevant data protection regulations should be in place to safeguard student data.

Regular monitoring and evaluation of the use of ChatGPT should be conducted to assess its effectiveness and address any ethical concerns that may arise. This monitoring can involve reviewing the interactions between students and the AI chatbot, analyzing the quality and accuracy of the generated content, and gathering feedback from both students and teachers. By actively monitoring its performance, institutions can identify and address issues, refine the system, and enhance the overall user experience.

Transparency, source attribution, user education, and regular review and auditing processes are additional components that contribute to the ethical deployment of ChatGPT (Khan et al., 2023). Transparently informing users that they are interacting with an AI chatbot and establishing clear attribution guidelines for sources the system uses promote transparency and academic integrity. User education programs should be implemented to familiarize students with AI chatbots’ capabilities and limitations and encourage responsible use. Regular review and auditing processes help ensure ongoing adherence to ethical guidelines and provide opportunities for improvement and refinement.

By integrating these ethical considerations and safeguards, educational institutions can foster responsible use of AI chatbots, maintain ethical standards, and enhance the overall learning experience for students. By establishing clear guidelines, providing human supervision, promoting critical thinking skills, prioritizing privacy, conducting regular monitoring, and upholding transparency, institutions can harness the benefits of AI technology while mitigating potential risks and ethical concerns—also, a scientific paper talks about academic integrity consideration (Helberger and Diakopoulos, 2023). After analyzing the ethical considerations discussed within the selected articles, the results are shown in the following tables. These tables provide an alternative representation of the ethical considerations and safeguards discussed in the paragraph. Table 4 focuses on ethical considerations, such as clear guidelines, human supervision, training, critical thinking, and privacy. Table 5 highlights the corresponding safeguards and actions, including monitoring, transparency, user education, and regular review and auditing processes.

The integration of ChatGPT in teaching and learning can significantly impact educators’ roles and the entire teaching-learning process. ChatGPT can revolutionize traditional instructional practices with its interactive and conversational capabilities and open new possibilities for personalized and engaging learning experiences.

One of the critical ways ChatGPT affects educators’ roles is by shifting their focus from being the primary sources of information to becoming facilitators and guides (DiGiorgio and Ehrenfeld, 2023). Instead of simply delivering content, educators can now assist students in navigating their interactions with ChatGPT. They can provide guidance on formulating practical questions, help students interpret and analyze the responses generated, and facilitate meaningful discussions based on the information provided. This transition empowers educators to take on a more active role in supporting and scaffolding student learning experiences.

Moreover, the integration of ChatGPT enables personalized and differentiated learning. Students can ask questions in their own words and receive tailored responses based on their specific formulations. This feature allows educators to address individual student needs and provide targeted support. By analyzing the responses generated by ChatGPT, educators can gain insights into students’ understanding and adapt their instructional strategies, fostering personalized learning experiences that cater to each student’s unique requirements.

In addition to personalized learning, ChatGPT promotes the development of inquiry and questioning skills among students. Educators can guide students in formulating practical questions and help them interpret and analyze the responses they receive. Conversations with ChatGPT encourage students to think critically, evaluate information, and refine their questioning techniques. This process enhances their ability to ask thoughtful and relevant questions and cultivates a deeper understanding of the subject matter.

Educators integrating ChatGPT into their teaching practices must monitor and assess how students use this technology as a learning tool. Educators can gain valuable insights into students’ learning processes by observing the types of questions asked, the quality of responses received, and the level of student engagement. This monitoring enables educators to provide timely feedback, address misconceptions, and ensure that students are effectively leveraging ChatGPT to enhance their learning outcomes.

It is important to note that the integration of ChatGPT also raises ethical considerations. Educators must guide students in using AI technologies like ChatGPT responsibly and ethically. This involves discussing privacy, data security, and potential biases in the training data that may impact the responses generated. By facilitating conversations around these ethical considerations, educators play a vital role in fostering digital literacy, responsible AI usage, and ethical decision-making.

In conclusion, the integration of ChatGPT in teaching and learning has transformative implications for the role of educators and the teaching-learning process. By shifting the focus from content delivery to facilitation and guidance, educators can empower students to participate in their learning actively. The personalized and differentiated nature of ChatGPT allows educators to address individual student needs, while its conversational capabilities promote inquiry and questioning skills. However, educators must also be mindful of the ethical considerations associated with using AI technologies and guide students in their responsible and ethical usage. With thoughtful integration and guidance, ChatGPT has the potential to revolutionize interactive learning environments and create engaging and personalized educational experiences. Also, this paper suggests what faculty should do to improve the educational role (McGee, 2023a). Based on the most frequent impact discussed in the selected articles, we categorize the aspects in Tables 6, 7. Table 6 represents the impact of ChatGPT on educators’ positions, and Table 7 represents ChatGPT integration’s benefits.

The first set of findings underscores the potential of integrating ChatGPT with other AI technologies to enhance human-computer interactions, enabling personalized responses and intuitive experiences (Aljanabi and ChatGPT, 2023). This integration has transformative impacts across various domains (Thorp, 2023). In education, ChatGPT fosters dynamic learning environments, promoting deep engagement and reflective thinking among students, thus creating opportunities for innovative teaching methods (Ollivier et al., 2023).

ChatGPT’s adaptive capabilities enable personalized learning experiences tailored to individual student needs, fostering inclusive education, and enhancing motivation and academic performance (Pericles ‘asher’ Rospigliosi, 2023). It also plays a significant role in academic writing processes, assisting researchers in drafting, summarizing, and conducting literature reviews (Bin Arif et al., 2023). Concerns regarding the accuracy and integrity of AI-generated scientific writing are addressed, emphasizing the importance of robust fact-checking and verification processes (Alkaissi and McFarlane, 2023).

Exploration of ChatGPT’s potential in detecting implicit hateful speech is noted, with caution urged in its utilization as a data annotation tool to prevent potential misinformation (Fijačko et al., 2023). Ethical considerations loom large in the discussion surrounding ChatGPT’s deployment, with responsible usage and ethical implications emphasized (DiGiorgio and Ehrenfeld, 2023).

Despite its benefits, challenges with ChatGPT include biases in AI models, the need for accuracy in responses, lack of emotional intelligence, and the absence of critical thinking abilities (Ahn, 2023). In education, human supervision is deemed crucial to ensure the accuracy and integrity of generated content (Huang et al., 2023). Training programs for educators are necessary to understand the capabilities and limitations of ChatGPT and address potential biases in AI-generated content (Khan et al., 2023).

Ethical considerations extend to promoting critical thinking skills among students and safeguarding privacy and data protection (Helberger and Diakopoulos, 2023). Integration of ChatGPT in teaching shifts educators’ roles from content delivery to facilitation and guidance, promoting personalized and differentiated learning experiences (McGee, 2023a). Overall, Table 8 presents a synthesis of findings from various research papers, each contributing to our understanding of the applications and implications of integrating ChatGPT in different contexts.