Teaching Model Kirkpatrick in e-learning and in social media
Published:
Jan 22, 2022
Keywords:
Kirkpatrick model instructional design learning design e-learning distance learning distance education
Abstract
The present study refers to the evaluation of the Kirkpatrick model in e-learning. In particular, it was important to examine the effectiveness of this model in digital distance educational environments and to assess its contribution to the improvement of both curricula and e-learning educators in order to overcome potential obstacles and reduce the risk of failure. The ultimate goal was to highlight good practices for improving this method of education. Based on the relevant literature, the research questions and sub-questions were formulated. The meta-analysis was chosen as the methodology of the study, which is inextricably linked to the systematic review and in their combination, safe conclusions can be drawn. From 21 extracted articles, 9 articles were deemed appropriate for the main stage of the meta-analysis. According to the results of the study, the Kirkpatrick model is used to measure the effectiveness of training programs, mainly, in relation to the first two levels and less to the third level while the fourth level is rarer. It is also used, mainly, in massive online courses (MOOCs) by Medical Schools. Finally, from the basic applications of online learning, the asynchronous e-learning was preferred during application of the examined model.
Article Details
- Issue
- Vol. 11 No. 6Α (2022)
- Section
- Articles
Authors retain copyright under a Creative Commons Attribution Non-Commercial License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in the proceedings.
References
Abernathy, D. (2019). ADDIE in Action: A Transformational Course Redesign Process. Journal for the Advancement of Educational Research 13(1), 8-19.
Adnan, N. H., & Ritzhaupt, A. D. (2017). Software Engineering Design Principles Applied to Instructional Design: What can we Learn from our Sister Discipline? TechTrends, 62, 77–94. DOI:10.1007/s11528-017-0238-5
Alonso, F., López, G., Manrique, D., & Viñes, J., M. (2005). An instructional model for web-based e-learning education with a blended learning process approach. British Journal of Educational Technology, 36 (2), 217-235. DOI: 10.1111/j.1467-8535.2005.00454.x
Alturkistani, A., Car, J., Majeed, A., Brindley, D.,Wells, G., & Meinert, E. (2018). Determining the effectiveness of a massive Open online course in data science for health. International Association for Development of the Information Society (IADIS) International Conference on e-Learning, 27-36. Retrieved from: https://eric.ed.gov/?id=ED590297
Aluko, F. R., & Shonubi, O. K. (2014). Going beyond Kirkpatrick's Training Evaluation Model: The role of workplace factors in distance learning transfer. Africa Education Review, 11(4), 638-657.
DOI: 10.1080/18146627.2014.935007
Amiti, F. (2020). Synchronous and Asynchronous E-Learning. European Journal of Open Education and E-Learning Studies, 5(2), 60-70. DOI:10.46827/ejoe.v5i2.3313
Ballera, M., & Elssaedi, M. M. (2013). New e-learning strategy paradigm: a multi-discplinary approach to enhance learning delivery. Proceedings of the 2nd E-Learning Regional Conference-State of Kuwait
Bandura, A. (2002). Social cognitive theory in cultural context. Journal of Applied Psychology: An International Review, 51, 269-290. DOI: 10.1111/1464-0597.00092
Barari, N., Zadeh, M. R., Khorasani, A., & Alami, F. (2020). Designing and validating educational standards for E-teaching in virtual learning environments (VLEs), based on revised Bloom’s taxonomy. Interactive Learning Environments, 1–13. DOI: 10.1080/10494820.2020.1739078
Branch, R. & Merrill, M. D. (2011). Characteristics of instructional design models. In R. A. Reiser & J.V. Dempsey (Eds.), Trends and issues in instructional design and technology (pp. 8–16). Upper Saddle River, NJ: Merrill-Prentice Hall.
Chang, N., & Chen, L. (2014). Evaluating the Learning Effectiveness of an Online Information Literacy Class Based on the Kirkpatrick Framework.
International Journal of Libraries and Information Studies, 64(3), 211-223. DOI: 10.1515/libri-2014-0016
Cohen, L., & Manion, L. (1994). Μεθοδολογία εκπαιδευτικής έρευνας. Αθήνα: Μεταίχμιο.
Coogle, C., & Floyd, K. (2015). Synchronous and Asynchronous Learning Environments of Rural Graduate Early Childhood Special Educators Utilizing Wimba© and Ecampus. MERLOT Journal of Online Learning and Teaching, 11(2), 173-187.
Creasman, P. A. (2012). Considerations in online course design. Manhattan, KS: The IDEA Center.
Creswell, J. (2016). Η Έρευνα στην Εκπαίδευση: Σχεδιασμός, Διεξαγωγή και Αξιολόγηση Ποσοτικής και Ποιοτικής Έρευνας (μτφ.: Κουβαράκου Ν. 2η έκδ.). Αθήνα: Ίων (έτος έκδ. πρωτοτύπου 2015).
Diamantopoulou, K. (2017). Comparative study of educational design models for e-learning. Advantages, disadvantages, applications and theoretical background (Thesis). University of the Aegean, Rhodes.
Dogoriti, Ε., Pange, J., & Anderson, G. (2014). The use of social networking and learning management systems in English language teaching in higher education. Campus-Wide Information Systems, 31(4), 254–263. DOI: 10.1108/CWIS-11-2013-0062
Edwards, M. E., & Black, E. W. (2012). Contemporary Instructor-Librarian Collaboration: A Case Study of an Online Embedded Librarian Implementation. Journal of Library & Information Services in Distance Learning, 6(3-4), 284–311. DOI: 10.1080/1533290X.2012.705690
Fernandes, R. A. M. L., de Oliveira Lima, J. T., da Silva, B. H.,
Sales, M. J. T., & de Orange, F. A. (2020). Development, implementation and evaluation of a management specialization course in oncology using blended learning. BMC Medical Education, 20(37), 1-10. DOI: 10.1186/s12909-020-1957-4
Galanis, P. (2009). Systematic review and meta-analysis. Archives of Greek Medicine, 26 (6): 826-841. Retrieved from www.mednet.gr/archives
Galloway, D. L. (2005). Evaluating distance delivery and e-learning is kirkpatrick's model relevant? Performance Improvement, 44(4), 21–27. DOI: 10.1002/pfi.4140440407
Goh, W. W., Wong, S. Y., & Ayub, E. (2018). The Effectiveness of MOOC among Learners based on Kirkpatrick’s Model. In: Tang S., Cheah S. (eds) Redesigning Learning for Greater Social Impact, p.p. 313-323. Springer, Singapore. DOI: 10.1007/978-981-10-4223-2_29
Hatziroufa, B. (2019). Design, implementation, distance evaluation of an in-company staff training program of "Hellenic Open University (Thesis). Hellenic Open University, Athens.
Hess, A. N. & Greer, K. (2016). Designing for Engagement: Using the ADDIE Model to Integrate High-Impact Practices into an Online Information Literacy Course. Communications in Information Literacy, 10 (2), 264-282. DOI:10.15760/comminfolit.2016.10.2.27
Hubalovsky, S., Hubalovska, M., Musilek, M. (2018). Assessment of the influence of adaptive E-learning on learning effectiveness of primary school pupils. Computers in Human Behavior, 92(), 691-705. DOI: 10.1016/j.chb.2018.05.033
Jones, P., & Davis, R. (2011). Instructional design methods integrating instructional technology. In I. Association (Ed.), Instructional design: Concepts, methodologies, tools and applications, 101-113). Hershey, PA: Information Science Reference. DOI: 10.4018/978-1-60960-503-2.ch110
Keengwe, J., Onchwari, G., Agamba, J. (2014). Promoting effective e-learning practices through the constructivist pedagogy. Education and Information Technologies, 19(4), 887–898. DOI: 10.1007/s10639-013-9260-1
Khalil, M. K., & Elkhider, I. A. (2016). Applying learning theories and instructional design models for effective instruction. Advances in Physiology Education 40, 147–156. DOI: 10.1152/advan.00138.2015
Kuh, G. D., Pace, C. R. & Vesper, N. (1997). The Development of Process Indicators to Estimate Student Gains Associated with Good Practices in Undergraduate Education. Research in Higher Education 38, 435–454. DOI: 10.1023/A:1024962526492
Lahti, M., Kontio, R., Pitkänen, A., Välimäki, M. (2014). Knowledge transfer from an e-learning course to clinical practice. Nurse Education Today, 34 (5), 842-847. DOI: 10.1016/j.nedt.2013.09.003
Lavender, D. T., Omoni, G., Lee, K., Wakasiaki, S., Campbell, M., Watiti, J., & Mathai, M. (2013). A pilot quasi-experimental study to determine the feasibility of implementing a partograph e-learning tool for student midwife training in Nairobi. Midwifery, 29(8), 876–884. DOI: 10.1016/j.midw.2012.10.003
Lin, J., & Cantoni, L. (2018). Decision, Implementation, and Confirmation: Experiences of Instructors behind Tourism and Hospitality MOOCs. The International Review of Research in Open and Distributed Learning, 19(1), 275-293. DOI: 10.19173/irrodl.v19i1.3402
Lionarakis, A. (2001a). Open and Distance Education: Reflections on a quality approach to teaching material design. In Lionarakis, A., (Ed.), Opinions and reflections on open and distance education (pp. 1-15). Athens: Propobos.
Moreira, I. C., Ramosa, I., Venturac, S.R., & Rodrigues, P.P. (2019). Learner’s perception, knowledge and behaviour assessment within a breast imaging E-Learning course for radiographers. European Journal of Radiology, 111(2019), 47–55. DOI: 10.1016/j.ejrad.2018.12.006
Ozdileka, Z., & Robeck, E. (2009). Operational priorities of instructional designers analyzed within the steps of the Addie instructional design model. Procedia - Social and Behavioral Sciences, 1(1), 2046-2050. DOI: 10.1016/j.sbspro.2009.01.359
Pange, J. (2014). Self regulated learning strategies in groups of learners. Tiltai Online Journal, 66(1), 169-181. DOI: 10.15181/tbb.v66i1.785
Pange, J., Toki, E. I. & Lekka, A. (2011). Distance learning: a myth or a necessity for educators? In Proceedings of IADIS International Conference on Higher Education, 80-84. Shanghai, China.
Papazisis, P. (2020). Design, implementation and evaluation of distance training for teachers: "Digital narration: from theory to practice" (Thesis). Aristotle University of Thessaloniki.
Pellas, N., Fotaris, P., Kazanidis, I., Wells, D. (2018). Augmenting the learning experience in primary and secondary school education: a systematic review of recent trends in augmented reality game-based learning. Virtual Reality 23, 329–346. DOI: 10.1007/s10055-018-0347-2
Pellas, N., Kazanidis, I., & Palaigeorgiou, G. (2019). A systematic literature review of mixed reality environments in K-12 education. Education Information Technologies 25, 2481–2520. DOI: 10.1007/s10639-019-10076-4
Pellas, N., Kazanidis, I., Konstantinou, N., & Georgiou, G. (2016). Exploring the educational potential of three-dimensional multi-user virtual worlds for STEM education: A mixed-method systematic literature review. Education and Information Technologies 22, 2235–2279. DOI: 10.1007/s10639-016-9537-2
Reinbold, S. (2013). Using the ADDIE Model in Designing Library Instruction. Medical Reference Services Quarterly, 32(3), p.p. 244–256. DOI: 10.1080/02763869.2013.806859
Reio, T. G., Rocco, T. S., Smith, D. H., & Chang, E. (2017). A Critique of Kirkpatrick's Evaluation Model. New Horizons in Adult Education and Human Resource Development, 29(2), 35–53. DOI: 10.1002/nha3.20178
Research initiatives. (n.d). Retrieved from University of Cyprus, Library, http://library.ucy.ac.cy/el/services/library-guides/evaluation_intresources
Sharif, A., & Cho, S. (2015). 21st-Century Instructional Designers: Bridging the Perceptual Gaps between Identity, Practice, Impact and Professional Development. International Journal of Educational Technology in Higher Education, 12(3), 72–85. DOI: 10.7238/rusc.v12i3.2176
Smith, P. L., & Ragan, T. J. (2005). Instructional Design (Third ed.). Hoboken, NJ: John Wiley & Sons, Inc.
Song, L., Singleton, E., Hill, J., R., & Koh, M. H. (2004). Improving Online Learning: Student Perceptions of Useful and Challenging Characteristics. Internet and Higher Education, 7(1), 59-70. DOI: 10.1016/j.iheduc.2003.11.003
Sun, P. C., Tsai, R. J., Finger, G., Chen, Y. Y., & Yeh, D. (2008). What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction. Computers & Education 50(4), 1183-1202. DOI: 10.1016/j.compedu.2006.11.007
Theodorelou, E. (2007). Design, production and evaluation of polymorphic educational material suitable for the distance education of philological educators of Secondary Education (Thesis). Hellenic Open University, Patras.
Toki, E. & Pange, J. (2012). Traditional and Computer-Based evaluation of preschoolers’ oral language in Greek - A review of the literature. Sino-US English Teaching, 9(1), 848-853.
Tsiolis, G. (2017). Thematic Analysis of Quality Data. Additional educational material in thematic unit ΕΚΠ51 – Postgraduate Programme: Sciences of Education. Hellenic Open University.
Zampelis, K. (2020). Educational design of Massive Open Online Courses (MOOC) (Thesis). National kapodistrian University of Athens.
Zemelman, S., Daniels, H., & Hyde, A. A. (2005). Best practice: today's standards for teaching and learning in America's schools (3rd ed.). Portsmouth, N.H.: Heinemann.
