Chat bots in the learning process - a student's perspective

Abstract

Introduction Chat bots (CB) are transforming the learning process with advantages and challenges. The aim of this study was to evaluate the impact of using CB in a learning activity (LA) on the awareness of the students for those advantages and challenges. Method 162 students of the Pharmacology II course of the Integrated Master in Pharmaceutical Sciences of the Faculty of Pharmacy of the University of Porto (FFUP), Portugal (4th year, 1st semester) were challenged to pose a question to a CB and confront the answer with classic sources of scientific information. At the end of the semester, an online questionnaire was delivered. Data was analysed descriptively. Results 55 students answered the questionnaire. Most (84%) had used CB, including in the Integrated Master in Pharmaceutical Sciences (60%), and considered to use it again (69%). Chat GPT was the mostly used CB (82%). Most students (82%) found the CB answer as consistent but generic. Development of critical thinking (75%) was the major contribution pointed out by the students, followed by a personalized learning experience (47%). The main advantages of CB in learning identified were the easy and quick access (98%), the real-time response (87%) and the guidance in searching information (73%), in opposition to the motivation (5%) and involvement (13%) in the curricular unit. The students mainly highlighted the need to confirm the information given by the CB with more credible information sources (82%) but also referred the value of critical thinking and/or prior knowledge on the subject (20%), and the importance of formulating the question correctly (15%). Conclusions Pharmacology II students of the Integrated Master in Pharmaceutical Sciences of the FFUP are prone to use CB in the learning process. The LA proposed contributed to promote the awareness of the students for the advantages and challenges of using CB.