A Chatbot-Based Expert System for Supporting Conceptual Understanding in DC Circuit Analysis: Development and Evaluation in Electrical Engineering Education

Benny Haposan Sianipar; Alifah Bigum Nabila; Usmeldi Usmeldi; Rahmiati Rahmiati

doi:10.35445/alishlah.v18i3.9817

A Chatbot-Based Expert System for Supporting Conceptual Understanding in DC Circuit Analysis: Development and Evaluation in Electrical Engineering Education

Benny Haposan Sianipar, Alifah Bigum Nabila, Usmeldi Usmeldi, Rahmiati Rahmiati

Abstract

This study addresses the limited development of chatbot-based expert systems that integrate rule-based reasoning and conceptual guidance for direct current (DC) circuit analysis learning in electrical engineering education. The study aimed to develop and evaluate a chatbot-based expert system designed to support students’ conceptual understanding of DC circuit analysis. A Research and Development (R&D) approach employing the 4D model (Define, Design, Develop, Disseminate) was applied in this study. The effectiveness evaluation used a one-group pretest–posttest design involving 25 undergraduate students from an Electrical Engineering Education program. The developed system was validated by one electrical engineering expert and two educational media experts before implementation. The validation results showed high validity across all evaluated aspects, with Aiken’s V values categorized as very valid. The practicality test indicated that the system was highly practical, achieving a mean score of 4.32 out of 5.00 (86.3%). The effectiveness test showed improvement in students’ learning outcomes, reflected by a normalized gain (N-gain) score of 0.32 in the moderate category. In addition, the paired sample t-test demonstrated a statistically significant difference between pretest and posttest scores (p < 0.001). Although the study was conducted with a limited sample and without a control group, the findings indicate that the chatbot-based expert system showed potential to support students’ conceptual understanding and procedural learning in DC circuit analysis. This study contributes to the development of AI-assisted learning media in vocational and engineering education, particularly in supporting interactive and concept-oriented learning environments.

Keywords

expert system; chatbot; DC circuit analysis; learning outcomes; artificial intelligence in education

References

Alemdag, E. (2025). The effect of chatbots on learning: A meta-analysis of empirical research. Journal of Research on Technology in Education, 57(2), 459–481. https://doi.org/10.1080/15391523.2023.2255698

Baidoo-Anu, D., & Owusu Ansah, L. (2023). Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Journal of AI, 7(1), 52–62. https://doi.org/10.61969/jai.1337500

Chiu, T. K. F., Xia, Q., Zhou, X., Chai, C. S., & Cheng, M. (2023). Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Computers and Education: Artificial Intelligence, 4, Article 100118. https://doi.org/10.1016/j.caeai.2022.100118

Deng, X., & Yu, Z. (2023). A meta-analysis and systematic review of the effect of chatbot technology use in sustainable education. Sustainability, 15(3), Article 2940. https://doi.org/10.3390/su15032940

Engelhardt, P. V., & Beichner, R. J. (2004). Students’ understanding of direct current resistive electrical circuits. American Journal of Physics, 72(1), 98–115. https://doi.org/10.1119/1.1614813

Giarratano, J. C., & Riley, G. D. (2005). Expert systems: Principles and programming (4th ed.). Thomson Course Technology.

Habibi, A., Muhaimin, M., Kopong, B., Gusti, Y., Wahyuni, S., & Octavia, A. (2023). ChatGPT in higher education learning: Acceptance and use. Computers and Education: Artificial Intelligence, 5, Article 100190. https://doi.org/10.1016/j.caeai.2023.100190

Jackson, P. (1999). Introduction to expert systems (3rd ed.). Addison-Wesley.

Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., Stadler, M., & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, Article 102274. https://doi.org/10.1016/j.lindif.2023.102274

Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2022). Interacting with educational chatbots: A systematic review. Education and Information Technologies, 28, 973–1018. https://doi.org/10.1007/s10639-022-11177-3

Laun, M., & Wolff, F. (2025). Chatbots in education: Hype or help? A meta-analysis. Learning and Individual Differences, 119, Article 102646. https://doi.org/10.1016/j.lindif.2025.102646

Okonkwo, C. W., & Ade-Ibijola, A. (2021). Chatbots applications in education: A systematic review. Computers and Education: Artificial Intelligence, 2, Article 100033. https://doi.org/10.1016/j.caeai.2021.100033

Ouyang, F., Zheng, L., Jiao, P., & Zhu, Y. (2022). Artificial intelligence in online higher education: A systematic review of empirical research from 2011 to 2020. Education and Information Technologies, 27(6), 7893–7925. https://doi.org/10.1007/s10639-022-10925-9

Pérez-Marín, D. (2021). A review of the practical applications of pedagogic conversational agents to be used in school and university classrooms. International Journal of Interactive Multimedia and Artificial Intelligence, 7(4), 18–33.

Smutny, P., & Schreiberova, P. (2020). Chatbots for learning: A review of educational chatbots for the Facebook Messenger. Computers & Education, 151, Article 103862. https://doi.org/10.1016/j.compedu.2020.103862

Thiagarajan, S., Semmel, D. S., & Semmel, M. I. (1974). Instructional development for training teachers of exceptional children: A sourcebook. Indiana University.

Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel? ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10, Article 15. https://doi.org/10.1186/s40561-023-00237-x

Wollny, S., Schneider, J., Di Mitri, D., Weidlich, J., Drachsler, H., & Specht, M. (2021). Are we there yet? A systematic literature review on chatbots in education. Frontiers in Artificial Intelligence, 4, Article 654924. https://doi.org/10.3389/frai.2021.654924

Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education—Where are the educators? International Journal of Educational Technology in Higher Education, 16, Article 39. https://doi.org/10.1186/s41239-019-0171-0

DOI: https://doi.org/10.35445/alishlah.v18i3.9817