Artificial Intelligence and Science Education: The Evaluation of ChatGPT in Understanding Thermal Phenomena

PDF (ελληνικά)
Published: Apr 6, 2025
DOI: https://doi.org/10.12681/codiste.7548
Keywords:
artificial intelligence (AI) heat temperature misconceptions science education
Georgia Vakarou
University of Ioannina
https://orcid.org/0009-0001-1235-8275
Georgios Stylos
Department of Primary Education, University of Ioannina
Kostas Georgopoulos
Department of Primary Education, University of Ioannina
Konstantinos Τ. Kotsis
Department of Primary Education, University of Ioannina
Abstract

Artificial intelligence (AI) has already begun to shape educational processes, with the potential to offer personalized learning and direct assistance to students. This study examines the effectiveness of AI, and especially ChatGPT, in understanding and teaching fundamental concepts such as heat and temperature. Through the Thermal Concept Evaluation (TCE) questionnaire, the research evaluates the scientific answers provided by ChatGPT and identifies any alternative perceptions. The study highlights the importance of critical thinking when using artificial intelligence technologies in science teaching, as the answers it provides are not always accurate and free from common misconceptions. Although there is an improvement in ChatGPT performance at a later stage, the limitations presented by AI technology highlight the need for continuous development and careful integration in training.

Article Details
  • Section
  • 14th Panhellenic Conference of Didactics in Science Education
Downloads
Download data is not yet available.
References
Βασιλικού, Μ. Π. (2023). Το ChatGPT περνάει στις Πανελλήνιες. Οι μαθητές;. Καζανίδης, Α. Τσινάκος (Επιμ.), Πρακτικά Εργασιών 13ου Πανελλήνιου και Διεθνούς Συνεδρίου «Οι ΤΠΕ στην Εκπαίδευση», Διεθνές Πανεπιστήμιο της Ελλάδας, Καβάλα, 29 Σεπτεμβρίου – 1 Οκτωβρίου 2023. ISSN: 2529-0916, ISBN: 978-618-83186-8-7
Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023). Revolutionizing education with AI: Exploring the transformative potential of ChatGPT. Contemporary Educational Technology, 15(3), ep429. https://doi.org/10.30935/cedtech/13152
Guggemos, J., & Seufert, S. (2024). Artificial intelligence in science education: Potentials and challenges. Research in Science Education. https://doi.org/10.1007/s11165-024-10176-3
Kortemeyer, G. (2023). Could an artificial-intelligence agent pass an introductory physics course?. Physical Review Physics Education Research, 19(1), 010132. https://doi.org/10.1103/PhysRevPhysEducRes.19.010132
OpenAI. (2024). GPT-4 technical report. Retrieved from https://openai.com/research
Shuster, K., Ju, D., Szlam, A., & Weston, J. (2022). The variability of language models in answering factual questions. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022). https://doi.org/10.18653/v1/2022.acl-long.230
Stylos, G., Sargioti, A., Mavridis, D., & Kotsis K.T. (2021). Validation of the thermal concept evaluation test for Greek university students’ misconceptions of thermal concepts. International Journal of Science Education, 43(2), 247-273. https://doi.org/10.1080/09500693.2020.1865587
West, C. G. (2023). Advances in apparent conceptual physics reasoning in GPT-4. Physical Review Physics Education Research, 19(1), 010132. https://doi.org/10.1103/PhysRevPhysEducRes.19.010132
Yeo, S., & Zadnik, M. (2001). Introductory thermal concept evaluation: Assessing students’ understanding. The Physics Teacher, 39(8), 496–504. https://doi.org/10.1119/1.1424603
Zhai, X. (2024). Exploring ChatGPT’s impact on science education: A review of applications and challenges. Education Sciences, 14(6), 643. https://doi.org/10.3390/educsci14060643