Development and Validation of a Scale about Teachers’ Practices on Promotion of Metacognition (TPPoM)
Author(s):
Vuslat Şeker (presenting / submitting) Yeşim Çapa-Aydın
Conference:
ECER 2015
Format:
Paper

Session Information

09 SES 11 B, Mathematics and Physics Learning and Teaching: Synthesizing Findings and Developing Instruments

Paper Session

Time:
2015-09-10
17:15-18:45
Room:
328. [Main]
Chair:
Andrejs Geske

Contribution

Metacognition is firstly conceptualized as knowledge and regulation of cognition (Flavell, 1979).  Flavell defined metacognition as “the active monitoring and consequent regulation and orchestration of these processes in relation to cognitive objects on which they bear, usually in the service of some concrete goal or objective” (as cited in Garafolo & Lester, 1985, p.232). It is a significant predictor of learning (Desoete, 2007; Veenman, Van-Hout-Waltors,& Afflerbach, 2006). It defines learning not only with cognitive processes, but it emphasizes that there is underlying processes occurring while learning (De Jager, Jansen, & Reezigt, 2005).

 Metacognitive skills can be described as a regulation of cognition (e.g. regulation of a problem-solving process). Metacognitively skilled learners have metacognitive knowledge about learning processes and use them in order to plan, monitor, evaluate and control their actions (Veenman, Wilhelm, & Beishuizen, 2004). Shraw (1998) emphasized three crucial metacognitive skills as planning related to allocation of time, sources and appropriate strategies, monitoring related to one’s awareness about cognitive activities while executing them, and evaluating related to assessment of learning process with respect to effectiveness and efficiency. Control component was defined as certain processes including the selection of strategy and quitting the activity after all process (Nelson,1996).

Metacognitive development is necessary because it contributes learners to be more effective while using their cognitive skills (Shraw, 1998), to be critical thinkers (Ku & Ho, 2010) and to be better problem solvers (Desoete, Roeyers, & Buysse, 2001).  Therefore, how metacognition develops and how educational settings contribute to metacognitive development are the objects of interest for researchers. Metacognition can be developed if an encouraging learning environment is provided for students (Larkin, 2010). Especially there is a need for effective teachers who have epistemological beliefs in terms of metacognitive and self-regulatory processes (Paris & Winograd, 1990).

Further research on why and how teachers promote metacognition is presented with recent research (Ader, 2009; Dignath-van Ewijk & van der Werf, 2012; Lombaerts et al, 2007; Lombaerts, Engels, & van Braak, 2008).  SRLTI is one scale measuring teachers’ recognitions about their practices on introduction of self-regulated learning practices (Lombaerts et al., 2007). They took into account 3 phases of self-regulation defined by Zimmerman; SRL forethought, SRL performance control and SRL self-reflection. 12 items per phase was generated. For the validity and reliability analysis, a pilot study was conducted with 399 primary school teachers. ML factor analysis results indicated three items were either cross-loading or freestanding, so eliminated. 3 factor loadings observed with the remaining 23 items with the variance of 50.3 %. They named the 1st factor as self-reflection phase, the 2nd factor as SRL performance control and the 3rd  factor as SRL forethought. For each factor, the reliability was found as .78, .83 and .88 respectively. All in all, a valid and reliable scale on SRL promotion was constructed.

The aim of this research is to develop and validate a scale on mathematics teachers’ recognitions about their practices on promotion of metacognition based on four processes of regulation of cognition; monitor, planning, evaluation and control. In this study, metacognitive skills as the regulation of cognition will be generally defined with monitoring, planning, evaluation and control. Developing such scale is important since it aims to find out mathematics teachers’ practices on promotion of metacognition in Turkey. With the scale, it can be reached out many mathematics teachers so what teachers do to promote metacognition in Turkey can be figured out to inform in-service and pre-service mathematics teacher educators so that they can adapt their learning environments accordingly. 

Method

Participants The sample of this study consists of 171 mathematics teachers including middle and high school levels. The sample was selected based on convenience sampling. The basic characteristics of the sample showed that 53.8 % of them were female and 45 % of them were male. 57.3 % of them were high school mathematics teachers whereas 40.9 % of them were middle school mathematics teachers. Procedure Item pool was generated through reviewing literature on teachers’ practices on metacognition and self-regulation. The focus was taken as regulation of cognition in the problem solving process that was main component of mathematics learning. 7 items for monitor dimension, 8 items for planning dimension, 9 items for evaluation dimension and 6 items for control dimension were generated. In total, 30 items were generated for the initial item pool (see Table 1) Table 1 Example Items for Dimensions of the Scale Dimensions Example items 1. Monitor “I want my students to monitor their goals while problem solving” (item 5) 2. Planning “I suggest my students to set goals before solving the problem” (item17) 3. Evaluation “I suggest my students to evaluate their process of the problem solving” (item 16) 4. Control “I guide my students to have control over their learning process” (item 15) A five point rating scale ranging from (1) “never”, (2) “rarely”, (3) “sometimes”, (4) “often”, and (5) “always” was used. Demographic information form was presented (gender, graduation level, graduation faculty, years of experience, school type, institution type, and current teaching level). The items of the scale were reviewed by a mathematics education professor to check for content validity. From three education specialists, face validity of the scale was checked. After expert reviews, some items were revised. Cognitive interview with a mathematics teacher working in a private school was conducted. After the reviews of experts and cognitive interview, the number of total items was decreased to 29. A mathematics teacher can get maximum 145 points representing always promoting student metacognition in his/her classroom and minimum 29 points in total representing never promoting student metacognition in his classroom. The principles of the schools were contacted to deliver the instruments to mathematics teachers. The instruments were collected from principals of the schools after a week. Data Analyses Several assumption-checks were done. Factor analysis was run after descriptive statistics in order to determine underlying structure of the TPPoM. Reliability analysis was conducted.

Expected Outcomes

After administration of scale, Mardia’s test was calculatedas significant, p=.00 indicating of a violation of normality assumption. The correlation matrix indicated the interrelation between items with minimum level of .30. Then Barlett’s test of sphericity was calculated as significant, p=.00. For multicollinearity determinant value of correlation matrix was calculated as 0000006 and a violation was observed. The Kaiser-Meyer Olkin measure of sampling adequacy (KMO) was calculated as .90. Then exploratory factor analysis (EFA) was run to examine the dimensionality of the scale. To cover violation of normality, a principal axis factor analysis was conducted for 29 items with eigenvalue over 1 and oblique rotation. The scree plot indicated four factors. The eight factors were observed through eigenvalue over 1 with total variance of 66.75 %. As a result, the factor analyses based on the scree plot and eigenvalue theory did not show presupposed mathematics teachers’ practices on metacognitive processes/skills. An explanation might be mathematics teachers’ practices on metacognition based on four skills can be very independent to each other. These practices might contribute to all skills implicitly although it aims to contribute one explicitly. Based on initial factor analyses and the structure of metacognitive regulation, an EFA with one fixed factor was run to examine whether the one-factor solution provides meaningful explanation for mathematics teachers’ practices on promotion of metacognition. All items loaded into one factor ranging from .77 to .33 with the total variance of 35.9 %. The factor was named as “Promotion of Metacognition Practices” since it includes possible practices of mathematics teachers on promotion of metacognition. The reliability of this scale was calculated as .94. All in all, although TPPoM can be showed basic characteristics of a reliable and valid scale for mathematics teachers, further validation processes are necessary through long run.

References

Ader, E. (2009). An ethnographic study of mathematics teachers’ promotıon of metacognition from a constructivist perspective. Unpublished doctoral dissertations. University of Nottingham. de Jager, B., Jansen, M., & Reezigt, G. (2005). The development of metacognition in primary school learning environments. School effectiveness and school improvement, 16(2), 179-196. Desoete, A. (2007). Evaluating and improving the mathematics teaching-learning process through metacognition. Electronic Journal of Research in Educational Psychology, 5(3), 705-730. Desoete, A., Roeyers, H., & Buysse, A.(2001). Metacognition and mathematical problem solving in grade 3. Journal of Learning Disabilities, 34(5), 435-449. Dignath-van Ewijk, C., & van der Werf, G. (2012). What Teachers Think about Self-Regulated Learning: Investigating Teacher Beliefs and Teacher Behavior of Enhancing Students’ Self-Regulation. Education Research International, 2012, 1-10. Flavell, J. H. (1979). Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry. American psychologist, 34 (10), 906-911. Garofalo, J., & Lester, F. K. (1985). Metacognition, cognitive monitoring, and mathematical performance. Journal for Research in Mathematics Education, 16, 163-176.. Larkin, S. (2010). Metacognition in young children. Abingdon, Oxon: Routledge. Lombaerts, K., Engels, N., & Athanasou, J. (2007). Development and validation of the self-regulated learning inventory for teachers. Perspectives in Education, 25(4), 29-47. Lombaerts, K., Engels, N., & van Braak, J. (2008). Determinants of teachers' recognitions of self-regulated learning practices in elementary education. The Journal of Educational Research, 102(3), 163-174. Nelson, T. O. (1996). Consciousness and metacognition. American psychologist, 51(2), 102-116. Paris, S. G., & Winograd, P. (1990). How metacognition can promote academic learning and instruction. Dimensions of Thinking and Cognitive Instruction, 1, 15-51. Schraw, G. (1998). Promoting general metacognitive awareness. Instructional Science, 26(1-2), 113-125. Veenman, M. V. J., Van Hout-Wolters, B. H. A. M., & Afflerbach, P. (2006). Metacognition and learning: conceptual and methodological considerations. Metacognition Learning, 1, 3-14. Veenman, M. V. J., Wilhelm, P., & Beishuizen, J. J. (2004). The relation between intellectual and metacognitive skills from a developmental perspective. Learning and Instruction, 14, 89-109.

Author Information

Vuslat Şeker (presenting / submitting)
Middle East Technical University
Elementary Education
İSTANBUL
Middle East Technical University, Turkey

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.