The Contribution of Prompt Engineering with Large Linguistic Models to the Development of Scientific Reasoning Skills in the Physics Course


Published: Apr 3, 2025
Keywords:
Large Language Models (LLMs) problem solving prompt engineering scientific reasoning skills
Antonios Matsigkos
Georgios Kritikos
Abstract

This research examines the role of prompt engineering with Large Language Models (LLMs), such as ChatGPT-4, as a learning tool for developing scientific reasoning skills and enhancing the ability to solve Physics problems to secondary school students. The main goal of the research is to integrate artificial intelligence models into traditional teaching methods, as "supporters" in learning in a student-centered environment. Utilizing prompt engineering strategies such as the chain of thought (CoT), the aim is to strengthen students' critical thinking and understanding of fundamental principles of Physics.

Article Details
  • Section
  • 14th Panhellenic Conference of Didactics in Science Education
Downloads
Download data is not yet available.
References
Bao, L., Fang, K., Cai, T., Wang, J., Yang, L., Cui, L., ... & Luo, Y. (2009). Learning of content knowledge and development of scientific reasoning ability: A cross culture comparison. American journal of physics, 77(12), 1118-1123. https://doi.org/10.1119/1.2976334
Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., ... & Zhang, Y. (2023). Sparks of artificial general intelligence: Early experiments with gpt-4. arXiv preprint arXiv:2303.12712. https://doi.org/10.48550/arXiv.2303.12712
Chi, M. T., Feltovich, P. J., & Glaser, R. (1981). Categorization and representation of physics problems by experts and novices. Cognitive science, 5(2), 121-152. https://www.sciencedirect.com/science/article/pii/S0364021381800298
Lawson, A. E. (1978). The development and validation of a classroom test of formal reasoning. Journal of Research in Science Teaching. https://doi.org/10.1002/tea.3660150103
Lawson, A. E. (1995). Science teaching and the development of thinking. Wadsworth. https://pdfs.semanticscholar.org/b572/bc13f6eaa64d84217e97ac5d3a5b84baedee.pdf
Lawson, A. E. (2000). The generality of hypothetico-deductive reasoning: Making scientific thinking explicit. The American Biology Teacher, 62(7), 482-495. https://doi.org/10.2307/4450956
MacIsaac, D. (2023). Chatbots attempt physics homework—chatgpt: Chat generative pre-trained transformer. The Physics Teacher, 61(4), 318-318. https://doi.org/10.1119/10.0017700
White, J., Hays, S., Fu, Q., Spencer-Smith, J., & Schmidt, D. C. (2024). Chatgpt prompt patterns for improving code quality, refactoring, requirements elicitation, and software design. In Generative AI for Effective Software Development (pp. 71-108). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-55642-5
Yeadon, W., Inyang, O. O., Mizouri, A., Peach, A., & Testrow, C. P. (2023). The death of the short-form physics essay in the coming AI revolution. Physics Education, 58(3), 035027. https://doi.org/10.48550/arXiv.2212.11661
Zimmerman, C. (2005). The development of scientific reasoning skills: What psychologists contribute to an understanding of elementary science learning. Final draft of a report to the National Research Council Committee on science learning kindergarten through eight grade. https://sites.nationalacademies.org/cs/groups/dbassesite/documents/webpage/dbasse_080105.pdf
Zimmerman, C. (2007). The development of scientific thinking skills in elementary and middle school. Developmental review, 27(2), 172-223. https://doi.org/10.1016/j.dr.2006.12.001
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Xia, F., Chi, E., ... & Zhou, D. (2022). Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, 35, 24824-24837.