Effects of Strategy-Instruction and Reciprocal Teaching: a Two-Year Longitudinal Study Among Low Achieving Adolescents

Session Information

31 SES 02, Educational Performance of Adolescents - Language and Influencing Factors

Paper Session

Time:
2014-09-02
15:15-16:45
Room:
B006 Anfiteatro
Chair:
Christoph Gantefort

Contribution

Many students in secondary education struggle with reading comprehension (e.g., Organisation for Economic Co-operation and Development [OECD], 2003). Since reading comprehension is a fundamental skill in many school subjects, problems with this skill have serious implications for students’ educational success and, consequently, for their later societal careers. Evidence-based reading comprehension programs that target low achieving adolescents are thus of vital importance. In this study, we analyze the effects of a reading strategy intervention based on principles of reciprocal teaching as introduced by Palincsar and Brown (1984). We examined its effects in the everyday practice of language teachers, teaching low achieving adolescents in secondary schools in The Netherlands, and we analyzed the roles of students’ vocabulary and metacognitive knowledge.

Reciprocal teaching (Palincsar & Brown, 1984) is a widely used method of instructing, teaching and guiding learners in reading comprehension. It consists of a set of three learning conditions: a) teaching comprehension-fostering reading strategies; b) expert modeling, scaffolding and fading; and c) students practicing reading strategies together with other students, guided and coached by the teacher. The gradual shift of responsibility includes the teacher explicitly modeling the use of reading strategies during the start of reciprocal teaching (Rosenhine & Meister, 1994) as well as scaffolding the application of reading strategies within the groups of students working together. During this process, students become increasingly more capable of regulating their own reading process and the role of the teacher gradually fades. Four types of reading strategies are normally taught: predicting, question generating, summarizing, and clarifying.

Reading strategies can be defined as “deliberate, goal-directed attempts to control and modify the reader’s efforts to decode text, understand words, and construct meanings of text” (Afflerbach, Pearson, & Paris, 2008: 368). Researchers have suggested many different strategies (Pressley & Afflerbach, 1995). What these strategies have in common is that they involve an awareness of reading goals, the activation of relevant background knowledge, the allocation of attention to major content while ignoring irrelevant details, the evaluation of the validity of text content, comprehension monitoring, and making and testing interpretations, predictions, and conclusions (Palincsar & Brown, 1984).  

Both vocabulary knowledge and metacognitive knowledge can be seen as important components of reading comprehension, and, therefore, likely factors in the success of reciprocal teaching.  One might argue that a certain level of both vocabulary- and metacognitive knowledge is a prerequisite for a successful implementation of reciprocal teaching. In an intervention study by Spörer, Brunstein and Kieschke (2009), no effect of the reading strategy clarification was found. They assessed clarification by asking students which words or concepts in a text needed clarification. This suggests that a certain level of vocabulary knowledge might be needed to apply those strategies. As for metacognitive knowledge, Trapman et al. (2012), for example, found that metacognitive knowledge significantly predicted low achievers’ reading comprehension in Grade 7. In addition, metacognition may play a crucial role in the application of reading strategies. In order to apply reading strategies adequately, one needs to be aware of one’s cognitive resources, the demands reading tasks pose, and the strategies available for enhancing comprehension (Flavell, 1979; Baker & Brown, 1980).

In this contribution, we present the outcomes of a randomized experiment in which we examined the effects of the intervention on students’ reading comprehension ability. Additionally, we examined to what extent vocabulary knowledge and metacognitive knowledge moderated the effects of the intervention.

Method

We conducted a two-year longitudinal field experiment, following a pretest-posttest randomized design. Ten pre-vocational schools (the two lowest tracks of the Dutch school system), each with two seventh grade classes participated in this study, with a total of 382 students. Each of the two classes per school (N=20), together with their teachers, were randomly assigned to an experimental or control condition. Experimental teachers were intensively trained and coached in working with the new method for teaching reading comprehension. Control teachers worked with the regular textbooks the school offered. The dependent variable, reading comprehension (SALT-Reading; Van Steensel, Oostdam, & Van Gelderen, 2012), was measured four times: at pretest, at the end of the first school year, at the start of the second school year and finally at the end of the second year. The SALT-reading was designed specifically for low achieving adolescents and encompassed eight different texts with both multiple choice and open-ended questions. In addition, non-verbal IQ (Raven Progressive Matrices; Raven, Raven & Court, 1998), vocabulary knowledge (Trapman et al., 2012), metacognitive knowledge (Trapman et al., 2012), gender, and language background were measured during the pretest. Repeated measures multilevel analyses (using MLwiN 2.16; Rasbash, Steele, Browne, & Goldstein, 2009) were performed to account for the hierarchical structure of the data. As no significant random variance was found at the school level, models with 3 levels were tested (occasion-, student-, and class level). We tested whether a) the treatment had a significant positive effect on reading comprehension, b) whether vocabulary knowledge moderated the effect of the treatment and c) whether metacognitive knowledge moderated the effect of the treatment. Adding predictors was done in the following order (Hox, 2010). First, all student level predictors were added (gender, IQ, and language background), with IQ centered around the grand mean (Hox, 2010). Second, the treatment variable was entered to answer the first research question. To answer the second research question, two new sets of analyses were performed, starting with the significant student-level predictors of the first set. Subsequently, the moderator variable vocabulary knowledge was entered after which the treatment variable was entered. Finally, the interaction between vocabulary knowledge and the treatment variable was entered. The same set of analyses was done for metacognitive knowledge. Both vocabulary knowledge and metacognitive knowledge were centered around the grand mean.

Expected Outcomes

No significant differences were found between the control and experimental classes at pre-test for vocabulary knowledge, IQ and reading comprehension, supporting the assumption that both conditions were comparable at the start of the treatment. The multilevel models first of all revealed positive main effects of IQ, and gender (girls do better) on reading comprehension at the first measurement. No interactions with occasion (growth) were found. No effect of language background was found; this variable was therefore omitted from further analyses. We did not find an effect of the experimental treatment on the growth in reading comprehension over two years. Moderator effects of vocabulary knowledge and metacognitive knowledge were tested subsequently. Both moderator variables showed significant positive main effects on reading comprehension, but only vocabulary knowledge moderated the effect of the treatment over time. This effect means that students scoring above average on vocabulary knowledge, benefited more from the treatment. However, the effect is rather small. Thus, a main effect of the intervention could not be established: overall, students in the experimental condition did not outperform students in the control condition. Even though a higher than average score on vocabulary knowledge significantly adds to reading comprehension in the experimental condition, this effect did not compensate the overall non-significant effect of the treatment. An explanation why the treatment did not improve reading comprehension compared to the control might be that the students’ own teachers incorporated the new method, as opposed to researchers (Hacker & Tenent, 2002), resulting in a less than optimal implementation of the new approach. Furthermore, reciprocal teaching was originally designed for small-group tutoring (Palincsar & Brown, 1984). Reciprocal teaching may not be quite as applicable in whole-classrooms, because in such situations it is hard for teachers to control students’ group activities.

References

Afflerbach, P., Pearson, P.D., & Paris, S.G. (2008). Clarifying differences between reading skills and reading strategies. Reading Teacher, 61, 364-373. Baker, L., & Brown, A. L. (1980). Metacognitive skills and reading. Technical report no. 188. Urbana-Champaign, IL: University of Illinois. Flavell, J. H. (1979). Metacognition and cognitive monitoring: A new area of cognitive developmental inquiry. American Psychologist, 34, 906-911. Hacker, D. J. & Tenent, A. (2002). Implementing reciprocal teaching in the classroom: Overcoming obstacles and making modifications. Journal of Educational Psychology, 94, 699-718 Hazenberg, S., & Hulstijn, J. H. (1996). Defining a minimal receptive second-language vocabulary for non-native university students: An empirical investigation. Applied Linguistics, 17, 145-163. Hox, J. J. (2010). Multilevel analysis: Techniques and applications. Second Edition. New York: Routledge. Organisation for Economic Co-operation and Development [OECD] (2003). The PISA 2003 assessment framework: Mathematics, reading, science and problem solving knowledge and skills. Paris: OECD. Palincsar, A. S., & Brown, A. (1984). Reciprocal teaching of comprehension-fostering and comprehension-monitoring activities. Cognition and Instruction, 1, 117-175. Pressley, M., & Afflerbach, P. (1995). Verbal protocols of reading: The nature of constructively responsive reading. Hillsdale, NJ: Erlbaum. Rasbash, J., Steele, F., Browne, W. J., & Goldstein, H. (2009). A user’s guide to MlwiN. Version 2.10. Bristol: University of Bristol, Centre for Multilevel Modelling. Raven, J., Raven, J.C., & Court, J.H. (1998). Manual for Raven’s Progressive Matrices and Vocabulary Scales. Section 1: General Overview. San Antonio, TX: Harcourt Assessment. Rosenshine, B., & Meister, C. (1994). Reciprocal teaching: A review of the research. Review of Educational Research, 64, 4, 479-530. Spörer, N., Brunstein, J.C., & Kieschke, U. (2009). Improving students’ reading comprehension skills: effects of strategy instruction and reciprocal teaching. Learning and Instruction, 19, 272-286. Trapman, M., Van Gelderen, A., Van Steensel, R, Hulstijn, J., & Van Schooten, E. (2012). Linguistic knowledge, fluency and meta-cognitive knowledge as components of reading comprehension in adolescent low achievers: Differences between monolinguals and bilinguals. Journal of Research in Reading, 0(0), 1-19. Van Steensel, R., Oostdam, R., & Van Gelderen, A. (2013). Assessing reading comprehension in adolescent low achievers: subskills identification and task specificity. Language Testing, 30(1), 3-21.

Author Information

Mariska Okkinga (presenting / submitting)
University of Twente
Voorburg
University of Ãmsterdam
Kohnstamm Institute
Amsterdam
Kohnstamm Institute, University of Amsterdam
Erasmus University Rotterdam
University of Twente, Netherlands, The

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.