Kahoot! Quizzes: A Formative Assessment Tool to Promote Students’ Self- Regulated Learning Skills

Nahla Helmy Nadeem, Hanady Abdulaziz Al Falig

Abstract


Gamified student response systems (GSRSs) have been increasingly used for formative assessment (FA) purposes in higher education. While previous studies on Kahoot! have given empirical evidence of the effectiveness of its gamified features in increasing students’ motivation, enhancing classroom dynamics and providing immediate feedback on students’ learning, the present study mainly investigates the students’ ratings of Kahoot! Quizzes (KQs) as a FA tool that facilitates the development of self-regulatory learning (SRL) skills. The study uses the seven principles of effective feedback to design a FA model that promotes students’ self- regulatory skills by defining the teacher’s role and students’ responsibilities while administering KQs. The study is a classroom action research that was done during a summer course and involved (n =70) female students in two linguistics courses. The researchers used a questionnaire and a focus group discussion to get students’ feedback on the effectiveness of KQs in enhancing their self-regulated learning. The results consistently showed positive evaluation of KQs along three dimensions: effective feedback, classroom environment and developing students’ meta-cognitive skills, the three essential ingredients of self-regulated learning. The model proved to be extremely effective in designing effective KQs that enhance students’ self- regulatory skills.


Keywords


Gamified student response system (GSRS), Kahoot! Quizzes (KQs), formative assessment (FA), feedback principles, self-regulated learning (SRL), and higher education

Full Text:

PDF

References


Aljaloud, A., Gromik, N., Billingsley, W. & Kwan, P. (2016). Research trends in student response systems: A literature review. International Journal of Learning Technology, 10 (4), 313–325. https://doi.org/10.1504/IJLT.2015.074073

Ang, E., Chan, J., Gopal, V., & Shia, N. (2018). Gamifying anatomy education. Clinical Anatomy, 31 (7), 997-1005

Attwell, G. & Hughes, J. (2010). Pedagogic approaches to using technology for learning: literature review, 1-78

Bandura, A. (1997). Self-efficacy: The exercise of control. NY: Freeman.

Barnard, L., Paton, V. O., & Lan,W. Y. (2008). Online self-regulatory learning behaviors as a mediator in the relationship between online course perceptions with achievement. International Review of Research in Open and Distance Learning, 9 (2), 1−11.

Beatty, I. & Gerace, W. (2009). Technology-enhanced formative assessment: A research-Based pedagogy for teaching science with classroom response technology. Journal of Science Education and Technology, 18(2), 146–162. http://doi.org/10.1007/s10956-008-9140-4

Biçen, H., & Kocakoyun, Ş. (2018). Perceptions of students for gamification approach: Kahoot! as a case study. International Journal of Emerging Technologies in Learning, 13(2). https://doi.org/10.3991/ijet.v13i02.7467

Black, P., & Wiliam, D. (2006). Assessment for learning in the classroom. In J. Gardner (Ed.), Assessment and learning (pp. 9 -25). London: Sage.

Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5–31.

Borrell, J., Cosmas, N., Grymes, J., & Radunzel, J. (2017). The effectiveness of Kahoot!! as a pre-lesson Assessment tool. Retrieved October 16, 2018 https://www.usma.edu/cfe/Literature/Borrell-Cosmas-Grymes-Radunzel_17.pdf.

Boekaerts, M., & Corno, L. (2005). Self-regulation in the classroom: A perspective on assessment and intervention. Applied Psychology: An International Review, 54(2), 199–231.

Bose, J., & Rengel, Z. (2009). A model formative assessment strategy to promote student-centered self-regulated learning in higher education. US-China Education Review, 6 (12), 29- 35.

Bullón, J., Encinas, A., Sánchez, M., & Martínez, V. (2018). Analysis of student feedback when using gamification tools in math subjects. IEEE Global Engineering Education Conference (EDUCON), 1818- 1823.

Burnstein, R. A. & Lederman, L. M. (2001). Using wireless keypads in lecture classes." The Physics Teacher, 39(1), 8-11.

Butler, D. L., & Winne, P. H. (1995). Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research, 65(3), 245–281.

Caldwell, J. E. (2007). Clickers in the large classroom: current research and best-practice tips. CBE-Life Sciences Education, 6 (1), 9-20.

Chaiyo, Y. & Nokham, R. (2017) The Effect of Kahoot!, Quizizz and Google Forms on the student's perception in the classrooms response system. International Conference on Digital Arts, Media and Technology (ICDAMT), 1-4.

Cheong, C., Cheong, F., & Filippou, J. (2013). Quick Quiz: A gamified approach for enhancing learning. Proceedings of the Pacific Asia Conference on Information Systems. http://aisel.aisnet.org/pacis2013/206

Clark, I. (2012a). Formative assessment: assessment is for self-regulated learning. Educational Psychology Review, 24(2), 205-249. DOI 10.1007/s10648-011-9191-6

Clark, I. (2012b). Formative assessment: A systematic and artistic process of instruction for supporting school and lifelong learning. Canadian Journal of Education, 35(2), 24-40.

Clark, D., Nelson, B., Chang, H., Martinez-Garza, M., Slack, K. & D’Angelo, C. (2011) Exploring Newtonian mechanics in a conceptually-integrated digital game: comparison of learning and affective outcomes for students in Taiwan and the United Statesâ€, Computers and Education, 57 (3), 2178–2195.

Cleary, T., Callan, G., Zimmerman, B. (2012). Assessing self-regulation as a cyclical, context-specific phenomenon: overview and analysis of SRL micro analytic protocols. Educational Research International. DOI: 10.1155/2012/428639

Cutri, R., Marim, L., Cordeiro, J., Gil, H., & Guerald, C. (2016). Kahoot! A new and cheap way to get classroom-response instead of using clickers. ASEE Annual Conference & Exposition, New Orleans.

Cutts, Q., Kennedy, G., Mitchell, C., & Draper. S. (2004). Maximizing Dialogue in Lectures using Group Response Systems. CATE, 421-426

Damick, J. (2015). Implementing Technology in an Algebra Classroom. MA thesis, NY: State University of New York.

Efklides, A. (2011). Interactions of metacognition with motivation and affect in self-regulated learning: The MASRL model. Educational Psychologist, 46(1), 6–25.

Elmahdi, I., Al-Hattami, A., & Fawzi, H. (2018). Using technology for formative assessment to improve students’ learning. TOJET: The Turkish Online Journal of Educational Technology, 17 (2), 182- 188.

Featherstone, M. (2016). Using Gamification to Enhance Self-directed, Open Learning in Higher Education.

Ferrándiz, E., Puentes, C., Moreno, P., Flores, E. (2016). Engaging and assessing students through their electronic devices and real time quizzes. Multidisciplinary Journal for Education, Social and Technological Sciences, 3 (2), 173- 184. DOI: https://doi.org/10.4995/muse.2016.6375

Göksün, D. & Gürsoy, G. (2019). Comparing success and engagement in gamified learning experiences via Kahoot! and Quizizz. Computers & Education, 135, 15–29.

Hanus, M. D., & Fox, J. (2015). Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic Motivation, social comparison, satisfaction, effort, and academic performance. Computers & Education, 80, 152–161. http://dx.doi.org/10.1016/j.compedu.2014.08.019

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112.

Irving, K. (2015). Technology-assisted formative assessment. In M. J. Urban and D. A. Falvo (Eds.), Improving K-12 STEM education outcomes through technological integration (pp. 380 – 398). http://doi.org/10.4018/978-1-4666-9616-7.ch017

Ismail, M.., & Mohammad, J. (2017). Kahoot!: A promising tool for formative assessment in medical education. Education in Medicine Journal, 9(2), 19–26.

Iwamoto, D., Hargis, J., Taitano, E., Vuong, K. (2017). Analyzing the efficacy of the testing effect using Kahoot! on student performance. Turkish Online Journal of Distance Education-TOJDE, 18 (2), 80-93.

Jarvela, S., Hadwin, A., Malmberg, J., & Miller, M. (2018). Contemporary perspectives of regulated learning in collaboration. In F. Fischer, C.E. Hmelo-Silver, P. Reimann, & S. R. Goldman (Eds.). Handbook of the learning sciences (pp. 127-136). New York: Routledge.

Kapp, K. M. (2012). The gamification of learning and instruction: game-based methods and strategies for training and education. San Francisco: John Wiley & Sons.

Kramarski, B., & Gutman, M. (2006). How can self-regulated learning be supported in mathematical E-learning environments? Journal of Computer Assisted Learning, 22, 24−33.

Kramarski, B., & Mizrachi, N. (2006). Online discussion and self-regulated learning: Effects of instructional methods on mathematical literacy. The Journal of Educational Research, 99(4), 218−230.

Lan, W. Y. (1996). The effects of self-monitoring on students' course performance, use of learning strategies, attitude, self-judgment ability, and knowledge representation. Journal of Experimental Education, 64, 101−115.

Lee, J. & Hammer, J. (2011). Gamification in Education: What, How, Why Bother? Academic Exchange Quarterly, 15 (2), 146–151.

Licorish, S., George, L., Owen, H., & Daniel, B. (2017). Go Kahoot!!†Enriching classroom engagement, motivation and learning experience with games. 25th International Conference on Computers in Education. New Zealand: Asia-Pacific society for computers in education.

Licorish, S., Owen, H., Daniel, B., & George, J. (2018). Students' Perception of Kahoot!’s influence on teaching and learning. Research and Practice in Technology Enhanced Learning, 13(1), 9.

Lim, T., Khor, C., Oon, Y. (2017) Measuring user engagement in mobile classroom response system: a case study. International Conference on Learning and Collaboration Technologies Novel Learning Ecosystems, 375-388.

Medina, E., & Hurtado, C. (2017). Kahoot!! A digital tool for learning vocabulary in a language classroom. Revista Publicando, 4(12), 441–449.

Nicol, D. J. & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199-218.

Orange, C. (1999). Using peer modeling to teach self-regulation. Journal of Experimental Education, 68(1), 21−39.

Panadero, E., Jonsson, A., & Strijbos, J. W. (2016). Scaffolding self-regulated learning through self-assessment and peer assessment: guidelines for classroom implementation. In D. Laveault & L. Allal (Eds.), Assessment for Learning: Meeting the challenge of implementation (pp. 311-326). Boston: Springer.

Pintrich, P. (1999). The role of motivation in promoting and sustaining self-regulated learning. International Journal of Educational Research, 31(6), 459-470.

Pintrich, P. R. (2000). The role of goal orientation in self-regulated learning. In P. P. M. Z. M. Boekaerts (Eds.), Handbook of Self-Regulation (pp. 451–502). Orlando, FL: Academic Press.

Pintrich, P. (2004). A conceptual framework for assessing motivation and self-regulated learning in college students. Educational Psychology Review, 16(4), 385–407.

Pintrich, P. R., & Zusho, A. (2002). The development of academic self-regulation: The role of cognitive and motivational factors. In A. Wigfield & J. S. Eccles (Eds.), Development of achievement motivation (pp. 250–284). San Diego: Academic Press.

Preszler, R., Dawe, A., Shuster, C., & Shuster. M. (2007). Assessment of the effects of student response systems on student learning and attitudes over a broad range of biology courses. CBE—Life Sciences Education, 6(1), 29–41. http://doi.org/10.1187/cbe.06-09-0190

Ramsey, B., & Duffy, A. (2016). Formative assessment in the classroom: Findings from three districts. Michael and Susan Dell Foundation and Education, 1. Retrieved from https://education-first.com/wpcontent/ uploads/2016/05/MSDF-Formative-Assessment-Study-Final-Report.pdf

Rodrigo, E. & Luiz, M. (2016). Kahoot!, A new and cheap way to get classroom-response instead of using clickers. American Society for Engineering Education’s 123rd Annual Conference & Exposition.

Roschelle, J., Penuel, W., Abrahamson, L. (2004). Classroom response and communication systems: research review and theory. Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA, April, 2004. Retrieved from

Russell, M. (219). Digital technologies: supporting and advancing assessment practices in the classroom. In Susan M. Brookhart, James H. McMillan (eds.) Classroom Assessment and Educational Measurement (pp. 224- 242). New York: Routledge.

Sadler, D. R. (1998). Formative assessment: revisiting the territory. Assessment in Education, 5(1), 77-84.

Sánchez-Mena, A., Martí-Parreño, J., & Aldás-Manzano, J. (2016). The role of perceived relevance and attention in teachers’ intention to use gamification. 15th European Conference on e-Learning - ECEL 2016At: Charles University, Prague. Czech Republic

Sánchez-Mena, A., Martí-Parreño, J. (2017). Drivers and barriers to adopting gamification: teachers’ perspectives. The Electronic Journal of e-Learning, 15 (5), 434-443.

Schell, J., Lukoff, B., & Mazur, E. (2013). Catalyzing learner engagement using cutting-edge response Systems in higher education. Cutting-Edge Technologies in Higher Education, 6, 233-261. http://doi.org/10.1108/S2044-9968(2013)000006E011

Schunk, D. H., & Zimmerman, B. J. (1997). Social origins of self-regulatory competence. Educational Psychologist, 32(4), 195–208.

Schunk, D. H., & Zimmerman, B. J. (2007). Influencing children’s self-efficacy and self-regulation of reading and writing through modeling. Reading and Writing Quarterly, 23(1), 7–25.

Sharples, M. (2000). The design of personal mobile technologies for lifelong learning. Computers & Education, 34(3-4), 177-193.

Solmaz, E., & Çetin, E. (2017). Ask-response-play-learn: students' views on gamification based interactive response systems. Journal of Educational and Instructional Studies in the World, 7(3), 28-40.

Spector, J., Ifenthaler, D., Sampson ,D., Yang, L., Mukama, E., Warusavitarana, A., Dona, K., Eichhorn, K., Fluck, A., Huang, R., Bridges, S., Lu, J., Ren, Y., Gui , X., Deneen, C., Diego, J., and Spector, D., Gibson, D. (2016). Technology enhanced formative assessment for 21st century learning. Journal of Educational Technology & Society, 19 (3), 58-71.

Stiggins, R. (1998) Classroom Assessment for Students Success. National Education Association of the United States. https://files.eric.ed.gov/fulltext/ED429990.pdf

Stiggins, R. J., Arter, J., Chappuis, S., & Chappuis, J. (2004). Classroom assessment for student learning: Doing it right—using it well. Portland, OR: Assessment Training Institute.

Sun, J. & Hsieh, P. (2018). Application of a gamified interactive response system to enhance the intrinsic and extrinsic motivation, student engagement, and attention of English learners. Journal of Educational Technology & Society, 21(3), 104-116.

Tan, P. & Saucerman, J. (2017). Enhancing learning and engagement through gamification of student response systems. American Society for Engineering Education,

Tsihouridis, C., Vavougios, D., & Ioannidis, G. S. (2017). Assessing the learning process playing with Kahoot! – A study with upper secondary school pupils learning electrical circuits. International conference on interactive collaborative learning, 602–612.

Turan, Z., & Meral, E. (2018). Game-based versus to non-game-based: the impact of student response systems on students' achievements, engagements and test anxieties. Informatics in Education, 1, 105-116

Wang, A. (2015). The wear out effect of a game-based student response system. Computers & Education.

Wang, T. (2008). Web-based quiz-game-Like formative assessment: development and evaluation. Computers & Education, 51, 1247–1263.

Wang, A. & Lieberoth, A. (2016). The effect of points and audio on concentration, engagement, enjoyment, learning, motivation, and classroom dynamics using Kahoot!!

Welbers, K., Konijn, E., Burgers, C., & Vaate, A, Eden, A. & Brugman. B. (2019). Gamification as a tool for engaging student learning: a field experiment with a gamified app. E-Learning and Digital Media, 16 (2), 92-109. https://doi.org/10.1177/2042753018818342

Yapıcı, İ.Ü., & Karakoyun, F. (2017). Gamification in biology teaching: A sample of Kahoot! application. Turkish Online Journal of Qualitative Inquiry, 8(4), 396–414.

Yıdızlı, H. & Saban, A. (2016). The effect of self-regulated learning on sixth-grade Turkish students’ mathematics achievements and motivational beliefs. Cogent Education, 3 (1), 1-17 http://dx.doi.org/10.1080/2331186X.2016.1212456

Zimmerman, B. J. (2002). Becoming a self-regulated learner: an overview. Theory into Practice, 41(2), 64–70.


Refbacks

  • There are currently no refbacks.


Copyright (c) 2020 Journal of Applied Linguistics and Language Research