Liesel Knaack’s research while affiliated with University of Ontario Institute of Technology and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (17)


Table 3. Correlations among Teacher Learning Object Evaluation Scale Constructs 
Teacher Evaluation of Learning Objects in Middle and Secondary School Classrooms
  • Article
  • Full-text available

March 2015

·

271 Reads

·

8 Citations

·

Liesel Knaack

Abstract Over the past 8 to 10 years, learning objects,which are web-based tools used to enhance learning, have been evaluated and received positively by higher education students. However, little research has been done examining teachers perceptions of learning objects, particularly in middle and secondary school environments. The purpose of the current study was to evaluate teachers’ assessment of learning objects used inmiddle,and secondary school classrooms. The Learning Object Evaluation Scale for Teachers (LOES-T) had moderate to good reliability, and demonstrated construct and convergent validity. Overall, most teachers rated learning objects as high quality tools that engaged students and promoted,successful learning. Teachers also noted that significant time was spent on searching for learning objects and preparing lessons. Technological problems related tolearning objects werenot reported often and focussed mostly on the speed of the Internet. The main suggestion offered by teachers was to be prepared to spend time selecting, testing, and preparing the materials in order to ensure successful use of learning objects.

Download

Table 2 Summary of student comments about audience response systems (n = 255)
Exploring the Use of Audience Response Systems in Secondary School Science Classrooms

April 2012

·

375 Reads

·

49 Citations

An audience response systems (ARS) allows students to respond to multiple choice questions using remote control devices. Once the feedback is collected and displayed, the teacher and students discuss misconceptions and difficulties experienced. ARSs have been extremely popular and effective in higher education science classrooms, although almost no research has been done at the secondary school level. The purpose of this study was to conduct a detailed formative analysis of the benefits, challenges, and use of ARSs from the perspective of 213 secondary school science students. Perceived benefits were increased student involvement (engagement, participation, and attention) and effective formative assessment of student understanding. Perceived challenges included decreased student involvement and learning when ARSs were used for summative assessment, occasional technological malfunctions, resistance to using a new method of learning, and increased stress due to time constraints when responding to questions. Finally, students rated the use of ARSs significantly higher when it was used for formative as opposed to summative assessment.


Table 1 Summary of aRS Quantitative Student Survey Questions (n=659) 
Table 2 Summary of Student Comments about audience Response Systems (n=526) 
Table 3 Mean aRS Survey item Scores as a function of Strategy used (n=611) 
Table 4 ManoVa examining attitude toward aRS as a function of Teaching Strategy 
Examining the Use of Audience Response Systems in Secondary School Classrooms: A Formative Analysis

January 2010

·

4,017 Reads

·

16 Citations

Journal of Interactive Learning Research

To date, extensive research has been done on the use of Audience Response Systems (ARSs) in colleges and universities, but not in secondary schools. The purpose of this study was to conduct a detailed formative analysis on the benefits, challenges, and use of ARSs from the perspective of 659 secondary school students. Key benefits reported were increased levels of engagement and motivation, the effective use of formative assessment, and a better quality learning environment. Key challenges included a perceived decrease in learning performance when an aRS was used for summative assessment, technological malfunctions, resistance to using a new method of learning, and increased stress due to perceived time constraints. finally, students consistently rated the use of an aRS significantly higher when it was used for formative as opposed to summative assessment.


Exploring Individual Differences in Attitudes toward Audience Response Systems

September 2009

·

97 Reads

·

8 Citations

Canadian Journal of Learning and Technology / La revue canadienne de l’apprentissage et de la technologie

The purpose of this study was to examine individual differences in attitudes toward Audience Response Systems (ARSs) in secondary school classrooms. Specifically, the impact of gender, grade, subject area, computer comfort level, participation level, and type of use were examined in 659 students. Males had significantly more positive attitudes toward ARSs than female students. Students who were more comfortable with computers had significantly more positive attitudes than students who were less comfortable. Students who did not actively participate in class before ARSs were used were more positive about this tool than students who regularly participated. Finally, students were significantly more positive about ARSs when they were used for formative (not for grades) as opposed to summative (for grades) assessment. There were no significant differences observed for grade level or subject area taught. Résumé La présente étude visait à étudier les variations personnelles dans la disposition des élèves du secondaire envers l’utilisation de systèmes de réponse, ou télévoteurs, en classe. Plus précisément, l’étude a examiné l’impact du sexe, de l’année d’études, de la matière, de l’aisance en informatique, du niveau de participation et du type d’utilisation sur 659 élèves. La disposition des garçons envers les télévoteurs était significativement meilleure que celle des filles. De plus, les élèves les plus à l’aise avec les ordinateurs avaient une réponse significativement plus positive que les élèves moins à l’aise. Les élèves qui ne participaient pas activement en classe avant l’utilisation de télévoteurs avaient quant à eux une attitude plus positive envers cet outil que les élèves qui participaient déjà régulièrement. Enfin, les élèves démontraient une attitude plus favorable envers les télévoteurs lorsque ceux-ci étaient utilisés aux fins d’évaluations formatives (non notées), par opposition aux fins d’évaluations sommatives (notées). Il n’y avait pas de différences significatives observées en fonction de l’année d’études ou de la matière enseignée.


Table 1 Description of student Learning Object Evaluation Scales (LOES-S) 
Table 3 Varimax rotated factor loadings on Learning Object Evaluation Scale for Students (LOES-S) 
Assessing Learning, Quality and Engagement in Learning Objects: The Learning Object Evaluation Scale for Students (LOES-S)

April 2009

·

2,601 Reads

·

161 Citations

Educational Technology Research and Development

Learning objects are interactive web-based tools that support the learning of specific concepts by enhancing, amplifying, and/or guiding the cognitive processes of learners. Research on the impact, effectiveness, and usefulness of learning objects is limited, partially because comprehensive, theoretically based, reliable, and valid evaluation tools are scarce, particularly in the K-12 environment. The purpose of the following study was to investigate a Learning Object Evaluation Scale for Students (LOES-S) based on three key constructs gleaned from 10 years of learning object research: learning, quality or instructional design, and engagement. Tested on over 1100 middle and secondary school students, the data generated using the LOES-S showed acceptable internal reliability, face validity, construct validity, convergent validity and predictive validity.


Table 2. Varimax Rotated Factor Loadings on Teacher Learning Object Evaluation Scale 
Table 3. Correlations among Teacher Learning Object Evaluation Scale Constructs 
Exploring Teachers Perceptions of Web-Based Learning Tools

January 2009

·

419 Reads

·

72 Citations

Interdisciplinary Journal of E-Learning and Learning Objects (IJELLO)

Over the past 8 to 10 years, web-based learning tools (WBLTs), also known as learning objects, have been evaluated and received positively by higher education students. However, little re-search has been done examining teachers perceptions of these tools, particularly in middle and secondary school environments. The purpose of the current study was to analyse teacher perceptions of the use of WBLT in middle and secondary school classrooms. Overall, most teachers rated WBLT s as easy-to-use and engaging for students. They also reported that WBLTs promoted successful learning. A number of teachers noted that significant time was spent searching for appropriate WBLT s and preparing lessons. Technological problems related to WBLTs were not reported often and focused mostly on Internet speed. The main suggestion offered by teachers was to be prepared to spend time selecting, testing, and preparing the materials in order to ensure successful use of WBLTs.


table 2 coding scheme to categorize student comments about Learning objects
table 3 Teacher Rating of Learning, Quality, and engagement for Learning objects
table 4 Qualitative comments from Teachers
table 5 description of student Learning object evaluation scales (Loes-s)
table 6 summary of student comments about Learning objects
Analysing the Effectiveness of Learning Objects for Secondary School Science Classrooms

January 2009

·

1,862 Reads

·

18 Citations

The current study offers a comprehensive, systematic analy-sis of learning objects used in secondary school science class-rooms. Five reliable and valid measures were used to exam-ine the effectiveness of learning objects for 503 students and 15 teachers in 27 science classrooms. The results suggest that teachers typically spend 1-2 hours finding learning objects and preparing lessons that often focus on the review of pre-vious material. both teachers and students are positive about the learning benefits, quality, and engagement value of learn-ing objects, although teachers are more positive than students. student performance increased significantly, almost 40%, when learning objects were used in conjunction with a vari-ety of teaching strategies including brief introductions, letting students work on their own, and providing guiding handouts. it is reasonable to conclude that science-based learning ob-jects are effective teaching tools in the secondary school en-vironment. a review of the literature on the use of technology in secondary school science classrooms (Kay & Knaack, 2007d) indicates that computers can be used to improve attitudes and learning performance; however, there is limited research on the use of web-based tools. a learning object defined as an "interactive web-based tool designed to enhance, amplify and guide learning," is a readily accessible, easy-to-learn, concept-focussed tool that is a promising alternative for teachers of science. in theory, good learning objects a require students to construct and manipulate information, provide rich feedback and interactive illustrations, help students understand abstract


Table 1 Mean Learning, Quality, and Engagement Scores as a Function of Purpose Chosen by Teachers 
Table 2 Student Performance as a Function of Purpose Chosen by Teachers 
Table 4 Student Performance as a Function of Integration Strategy 
A Formative Analysis of Instructional Strategies for Using Learning Objects

January 2009

·

145 Reads

·

9 Citations

Journal of Interactive Learning Research

To date, limited research has been done examining and evaluating the instructional wrap for using learning objects effectively. The current study examined instructional strategies used by 15 teachers to integrate learning objects into 30 secondary school classrooms (510 students). Four key areas were examined: preparation time, purpose for using a learning object, integration strategies, and time spent using a learning object. A small, but significant, correlation was observed between preparation time and student attitudes toward learning objects. When the purpose of using a learning object was to introduce a concept before a formal lesson, motivate students , or teach a new concept, student attitudes and performance were significantly higher. On the other hand, choosing to use a learning object after a formal lesson or to review a concept resulted in significantly lower student attitudes and performance. Regarding integration strategies, providing a guiding set of questions was associated with more positive student attitudes and increased performance, whereas allowing students to explore on their own (without direction) and class discussion after use led to significantly lower student attitudes and performance. Finally, time spent using learning objects was inversely correlated with student attitudes and performance. It is reasonable to conclude that decisions about instructional wrap had a significant impact on the effectiveness of learning objects in a secondary school environment.


Table 1 Mean Learning, Quality, and Engagement Scores as a Function of Purpose Chosen by Teachers 
Table 2 Student Performance as a Function of Purpose Chosen by Teachers 
Table 3 Mean Learning, Quality, and Engagement Scores as a Function of Integration Strategys 
Table 4 Student Performance as a Function of Integration Strategy 
A Formative Analysis of Resources Used to Learn Software

January 2009

·

109 Reads

·

15 Citations

Journal of Interactive Learning Research

To date, limited research has been done examining and evaluating the instructional wrap for using learning objects effectively. The current study examined instructional strategies used by 15 teachers to integrate learning objects into 30 secondary school classrooms (510 students). Four key areas were examined: preparation time, purpose for using a learning object, integration strategies, and time spent using a learning object. A small, but significant, correlation was observedbetween preparation time and student attitudes toward learning objects. When the purpose of using a learning object was to introduce a concept before a formal lesson, motivate students, or teach a new concept, student attitudes and performancewere significantly higher. On the other hand, choosing to use a learning object after a formal lesson or to review a concept resulted in significantly lower student attitudes and performance. Regarding integration strategies, providing a guiding set of questions was associated with more positive student attitudes and increased performance, whereas allowing students to explore on their own (without direction) and class discussion after use led to significantly lower student attitudes and performance. Finally, time spent using learning objects was inversely correlated with student attitudes and performance. It is reasonable to conclude that decisions about instructional wrap had a significant impact on the effectiveness of learning objects in a secondary school environment.


Table 1 Teacher Rating of Learning, Design, and Engagement for WbLTs
Table 2 Student Rating of Learning, Design, and Engagement for WbLTs
Table 3 Summary of Student Comments about WbLTs
Table 3 continued
Table 4 Pre-Post Test Score Differences
Exploring the Impact of Learning Objects in Middle School Mathematics and Science Classrooms: A Formative Analysis

December 2008

·

202 Reads

·

15 Citations

Canadian Journal of Learning and Technology / La revue canadienne de l’apprentissage et de la technologie

The current study offers a formative analysis of the impact of learning objects in middle school mathematics and science classrooms. Five reliable and valid measure of effectiveness were used to examine the impact of learning objects from the perspective of 262 students and 8 teachers (14 classrooms) in science or mathematics. The results indicate that teachers typically spend 1-2 hours finding and preparing for learning-object based lesson plans that focus on the review of previous concepts. Both teachers and students are positive about the learning benefits, quality, and engagement value of learning objects, although teachers are more positive than students. Student performance increased significantly, over 40%, when learning objects were used in conjunction with a variety of teaching strategies. It is reasonable to conclude that learning objects have potential as a teaching tool in a middle school environment. L’impacte des objets d’apprentissage dans les classes de mathématique et de sciences à l’école intermédiaire : une analyse formative Résumé : Cette étude présente une analyse formative de l’impacte des objets d’apprentissage dans les classes de mathématique et de sciences à l’école intermédiaire. Cinq mesures de rendement fiables et valides ont été exploitées pour examiner l’effet des objets d’apprentissage selon 262 élèves et 8 enseignants (414 classes) en science ou mathématiques. Les résultats indiquent que les enseignants passent typiquement 1-2 heures pour trouver des objets d’apprentissage et préparer les leçons associées qui seraient centrées sur la revue de concepts déjà vus en classe. Quoique les enseignants aient répondu de façon plus positive que les élèves, les deux groupes ont répondu positivement quant aux avantages au niveau de l’apprentissage, à la qualité ainsi qu’à la valeur motivationnelle des objets d’apprentissage. Le rendement des élèves aurait aussi augmenté de façon significative, plus de 40%, quand les objets d’apprentissage ont été exploités avec une variété de stratégies d’enseignement. Il serait donc raisonnable de conclure que les objets d’apprentissage ont un potentiel comme outils d’enseignement à l’école intermédiaire.


Citations (17)


... Only one study was found looking at the effect of preparation time and the use of apps in the classroom. Kay [29] observed that finding a suitable app took, on average 30 to 60 minutes. Furthermore, creating an app-based lesson required 15 to 60 minutes [29]. ...

Reference:

Examining individual differences in the use of STEM-based mobile apps
A Formative Analysis of Instructional Strategies for Using Learning Objects

Journal of Interactive Learning Research

... Collaboration approaches and co-operative learning, here used interchangeably as done by Johnson and Johnson (2008), refer to technology training situations where two or more student teachers "work together to maximize their own and each other's learning" (Goodyear, Jones, & Thompson, 2014, p. 440). 25 out of 42 studies focused on developing student teachers' digital competence afforded through synchronous and asynchronous collaborative knowledge-building technologies including online forums, discussion boards, and learning networks (e.g., Ajayi, 2009;Doering & Beach, 2002;Jang, 2008aJang, , 2008bKay & Knaack, 2005;Masats & Dooly, 2011), social networking sites and other interactive Web 2.0 applications (e.g., Carlson & Archambault, 2013;Skerrett, 2010), weblogs or blogs (e.g., Hutchison & Wang, 2012), computer-mediated communications software and virtual environments (e.g., Develotte, Mangenot, & Zourou, 2005;Fuchs, 2006;Sardone & Devlin-Scherer, 2008), and collaborative software (e.g., Bravo & Young, 2011;Brodahl, Hadjerrouit, & Hansen, 2011;Foulger, Williams, & Wetzel, 2008;Öztürk, 2012). In their exploratory case study with 201 student teachers, for instance, Brodahl et al. (2011) used Google Docs and EtherPad to assess whether the technologies could support collaborative writing and how effective the tools were in a group work setting. ...

A Case for Ubiquitous, Integrated Computing in Teacher Education

Technology Pedagogy and Education

... Research addresses the effects of concrete materials on math education (Herron & Foster, 2017;Kutluca & Akın, 2013;Poon & Wong, 2017;Yılmazer & Keklikci, 2015), effectiveness of materials based on realistic math education (Hasibuan et al., 2019), teachers' thoughts about using concrete materials in math education (Yazlık, 2018), the importance of developing materials for math education (Bozkurt & Akalın, 2015), primary school teachers' beliefs and expectations of concrete materials in math education (Gökmen et al., 2016), metaanalysis on the effects of educational materials on math performance (Kul et al., 2018), effectiveness of hands-on math activities at different grade levels (Magrone et al., 2019), effects of experimental materials on math performance (Mutmainah et al., 2019), preservice teachers' self-efficacy in using concrete materials in math education (Pişkin-Tunç et al., 2012), teachers' views on what makes math learning environments effective (Öztürk & Güven, 2012), and the use of learning objects in math education (Baki & Çakıroğlu, 2010;Kay & Knaack, 2008;Oliveira & Neto, 2019). However, there is no published research on preservice teachers designing materials and using them in real-life classroom settings. ...

Exploring the Impact of Learning Objects in Middle School Mathematics and Science Classrooms: A Formative Analysis

Canadian Journal of Learning and Technology / La revue canadienne de l’apprentissage et de la technologie

... Objective of the current research to identify the most appropriate strategy for electronic brainstorming learning (individual) in Google plus environment with Locus of Control of internal and external, regarding their impact on the development of both cognitive and functional aspect of instructional design skills, and scientific thinking skills for graduate students, their engagement in the Google plus environment that was handled in a synchronous format in accordance with the collective electronic brainstorming, and asynchronous in accordance with individual electronic brainstorming, research sample was selected randomly from the students Graduate School of education technology of its faculty of specific education (40) students, are categorized according to the Locus of Control (group With internal Locus of Control, a group of With external Locus of Control) classification variable into four experimental groups, and effective application of the experimental treatment materials, after making statistical, results from differences of statistical significance between the experimental groups students grades averages in cognitive achievement test associated with instructional design skills and product scorecard design skills tutorial and scientific thinking skills due to the primary influence for electronic brainstorming strategies (individual vs collective) For electronic brainstorming collective associated with external groups students with Locus of Control, and The results indicated the presence of electronic brainstorming strategies impact on student engagement in electronic brainstorming environment for collective electronic brainstorming strategy with internal Locus of Control, the results indicated a statistically significant differences between the average grades of students Experimental groups due to the impact of the interaction between the independent variables to search the address of variables to search in Google plus environment on both of them as follows: (collective electronic brainstorming with his face set, individual electronic brainstorming with his face set, with regard to engage back than Electronic brainstorming collective with internal tuning). (Francis, David, & Murphy, et al., 2008;Kay, & Knaack, 2007;Elliott, & et al., 2008 (Smith and Ragan, 1999: 14-16;Gillard, et. al., 2005 ...

Teacher Evaluation of Learning Objects in Middle and Secondary School Classrooms

... The assessment test was based on a validated test (Kay & Knaack, 2009) which was adapted for primary school students with a more relatable vocabulary for them. Specifically, the administered test consisted of 11 questions with a Likert scale from 1 to 5 (1 being Not interesting and 5 Very interesting), along with an open-ended question where students could express their thoughts about the workshops. ...

Assessing Learning, Quality and Engagement in Learning Objects: The Learning Object Evaluation Scale for Students (LOES-S)

Educational Technology Research and Development

... Numerous technologies, such as Skype, Elluminate, Wimba, Second Life, the phone, MSN Messenger, Wikis, microblogging, email, ePortfolio, Microsoft Office Share-Point for group authoring, and WebCT, are increasingly being used in supervision (Kay et al. 2019). Technological developments in data management tools, software, and predictive analytics (e.g., NVivo, CAQDAS, QDA Miner, and MAXQDA) can potentially have a rapid impact on research methodologies. ...

Exploring Teachers Perceptions of Web-Based Learning Tools

Interdisciplinary Journal of E-Learning and Learning Objects (IJELLO)

... To collect social validity data and promote students' skills through their experience, they answered an adapted 3point Likert questionnaire (disagree , neither disagree nor agree , agree ) of 18 items based on the Learning Object Evaluation Survey for Students (LOES-S) (Kay and Knaack 2005). The use of smiley faces, ranging from happy (positive response) to sad (negative response), was chosen to make the scale visually intuitive and accessible for students with ID, who often struggle with literacy or reading skills. ...

Developing Learning Objects for Secondary School Students: A Multi-Component Model

Interdisciplinary Journal of E-Learning and Learning Objects (IJELLO)

... DLOs allow students to work hands-on with complex content and ideas, so that students develop the ability to analyze, synthesize, explore, solve problems, make decisions and reflect in a supportive and engaging learning environment (Janson & Janson, 2009). In addition, DLOs have a substantial effect that addresses teacher's mission when it comes to obstacles that teachers face when using technology including time, difficulties in learning new software, integrating strategies, and accessibility (Kay & Knaack, 2008c). Moreover, DLOs helps students to construct information, provide innovative reflections, recognize complex ideas with concrete representations, retrieve easily the information especially the ones that have problem in retrieving long term memory (Akpinar & Bal, 2006). ...

Investigating the Use of Learning Objects for Secondary School Mathematics

Interdisciplinary Journal of e-Skills and Lifelong Learning

... Συγκεκριμένα, η αξιοποίηση Ψηφιακών Μαθησιακών Αντικειμένων (ΨΜΑ), μπορεί να διαδραματίσει σημαντικό ρόλο στην υποστήριξη της εκπαίδευσης των φοιτητών και έχει θετική επίδραση στη μαθησιακή διαδικασία και τα μαθησιακά αποτελέσματα (Dias & Alves Diniz, 2014). Τα ΨΜΑ αποτελούν συνοπτικές επαναχρησιμοποιήσιμες ενότητες ψηφιακού περιεχομένου με σαφείς εκπαιδευτικούς στόχους που έχουν σχεδιαστεί με σκοπό να βελτιώνουν, να ενισχύουν και να καθοδηγούν τη μαθησιακή διαδικασία (Kay & Knaack, 2009). ...

Analysing the Effectiveness of Learning Objects for Secondary School Science Classrooms

... Most research on pedagogy and the use of WbLTs has focused on choices made by instructors when using WbLTs in their classrooms. Key areas of focus have included preparation time (Kay, Knaack & Muirhead, 2009), coaching or facilitation (Liu & bera, 2005), establishing context (Schoner, buzza, Harrigan, & Strampel, 2006), purpose of using WbLT , asking students to evaluate their own actions while learning (van Marrienboer & ayres, 2005), and providing some sort of instructional guide or scaffolding (brush & Saye, 2001;Concannon et al.,, 2005;Kay et al., 2009;Lim, Lee & Richards, 2006;Mason, Pegler, &Weller, 2005;Mayer, 2004). ...

A Formative Analysis of Resources Used to Learn Software

Journal of Interactive Learning Research