The Reception of PISA in Slovenia: good results - weak impact and vice versa
Author(s):
Urška Štremfel (presenting / submitting)
Conference:
ECER 2012
Format:
Paper

Session Information

ERG SES C 09, Teaching and Learning

Parallel Paper Session

Time:
2012-09-17
13:30-15:00
Room:
FCEE - Aula 2.9
Chair:

Contribution

The Programme for International Student Assessment (PISA) 2009 results showed for the first time since Slovenia has been participating in international comparative assessment studies that Slovenian students perform below the EU and OECD average. These results have triggered extensive scientific discussions and policy debates, not to mention extensive public and media attraction. As a response, efforts and activities to improve Slovenia’s performance in the next PISA cycles were promptly undertaken. Now, nearly two years after the official announcement of the PISA 2009 results, it is time to synthesize and systematically estimate the responses and activities in the entire Slovenian educational space.

The paper highlights the reception of PISA 2009 results in Slovenia through the theoretical lenses of new modes of governance, policy learning theory and evidence-based policy making. Authors (Ioannidou 2007; Lange and Alexiadou 2007; Wiseman 2010) agree that new modes of governance in the field of education are based on diverse knowledge-based governing tools. Since education is an area that does not require harmonization of national laws and regulations with EU legislation, the main mechanism for translating common agreed EU goals in national contexts is policy learning.

Although the role that international assessment studies plays in national education policies has been frequently addressed, authors agree that empirical evidence in the field is missing. The research question addressed in this paper – “What is the real role of international comparative assessment studies in national education policies and therefore in the European educational space?”– has not yet been satisfactorily answered. The basic objective of the paper is to fill this research gap by providing an innovative research framework for investigating the role of international comparative assessment studies in national education policies with the case study of PISA 2009 in Slovenia. In order to understand the reception of PISA in a national setting, both the institutional context in which the PISA is to be implemented and the micro politics of the PISA (i.e. actor responses and activities as well as relationships between actors) need to be taken into account (Jacobsson and Johanson 2007). Our own analytical model is therefore used, focusing on the questions: Who (are the most influential actors in translating and disseminating PISA results on a national level)? Which (are the instruments and mechanisms these actors use to attract other relevant actors in the Slovenian education space)? And what (is the expected effect of implemented activities)? Overall, the paper systematically explains the strong response to PISA 2009 results in comparison to the lack of attention that accompanied the announcement of above average PISA 2006 results in addition to other international comparative assessment studies in which Slovenia took part (TIMSS, PIRLS, ICCS etc.).

Method

This paper draws on theoretical and empirical evidence. The above mentioned research question will be addressed by an already completed comprehensive review of the academic literature on new modes of governance, policy learning theory and evidence-based policy. Additionally, a review of Slovenian policy documents, non-official documents (interim reports, communications), press releases, newspaper articles and speeches will be completed. Based on the complexity and particularity of this unique case, the PISA 2009 case study and the three competences it measures (reading, math and science) will be presented in comparison to PISA 2006 and other international comparative assessment studies where relevant. Additional empirical evidence will be gathered with semi-structured interviews of policy makers and experts at the national level. Interviews carried out at Directorate General for Education and Culture in Brussels in January 2010 will also be taken into consideration. The most extensive part of the data will be gathered through mailed questionnaires that will be sent to Slovenian experts in the field of education that are also active at the EU/international level, to education policy makers, and to stakeholders (headmasters, teachers).

Expected Outcomes

Although this study is specific to Slovenia, empirical findings will be useful for the wider public (other member states and their policy makers, EU policy makers) due to the nature of the theories used. It is also anticipated that the results will contribute to the already vigorous academic debate in this field. The expected results will provide missing empirical evidence about the impact of international student assessment studies on national education policies. In addition, it will shed light on how the national educational policy arena is being shaped by external monitoring of supranational actors and technologies of cross-border comparison. This paper will reveal in what respect the local specificities of cultural and historical context explain the national reception, interpretations, and use of PISA (Delvaux and Mangez 2008). Although the subject is a rather contested area of educational research and political science, we believe this paper will present alternative and innovative approaches of discovering how international comparative assessment studies influence national education policies and therefore convergence of the European educational space.

References

Ertl, Hubert. 2006. Educational standards and the changing discourse on education: the reception and consequences of the PISA study in Germany. Oxford Review of Education 32 (5): 619-634. Grek, Sotiria. 2009. Governing by numbers: the Pisa effects in Europe. Journal of Education Policy 24 (1): 23-37. Grek Sotiria, Lawn Martin and Jenny Ozga. 2009. PISA and the policy debate in Scotland. Policy narratives about Scottish participation in the international comparison. Sísifo, Educational Sciences Journal 10: 73-84. Grek, Sotiria and Bob Lingard. 2010. The OECD, indicators and PISA: an exploration of events and theoretical perspectives. Edinburgh: University of Edinburgh, Research Project on Fabricating Quality in Education Working paper, No. 2. Ioannidou, Alexandra. 2007. A Comparative Analysis of New Governance Instruments in the Transnational Educational Space: a shift to knowledge-based instruments? European Educational Research Journal 6 (4): 336-347. Lange, Bettina and Nafsika Alexiadou. 2007. New Forms of European Union Governance in the Education Sector? A Preliminary Analysis of the Open Method of Coordination. European Educational Research Journal 6 (4): 321-335. Lawn, Martin. 2006. Soft governance and the learning spaces of Europe. Comparative European Politics 4: 272 -288. Rutkowski, David and Laura C. Engel. 2010. Soft Power and Hard Measures: large-scale assessment, citizenship and the European Union. European Educational Research Journal 9 (3): 381 395. Steiner-Khamsi, Gita. 2004. The Global Politics of Educational Borrowing and Lending. New York: Teachers College Press. Štremfel, Urška and Damjan Lajh. 2010. Implementing EU lifelong learning policy through open method of coordination in new member states : comparative analysis of the Czech republic, Slovakia and Slovenia. Journal of comparative politics 3 (2): 64-84. Wiseman, W. Alexander. 2010. The Uses of Evidence for Educational Policymaking: Global Contexts and International Trends. Review of Research in education 34 (1): 1-24.

Author Information

Urška Štremfel (presenting / submitting)
Educational Research Institute Slovenia
Ljubljana

Update Modus of this Database

The current conference programme can be browsed in the conference management system (conftool) and, closer to the conference, in the conference app.
This database will be updated with the conference data after ECER. 

Search the ECER Programme

  • Search for keywords and phrases in "Text Search"
  • Restrict in which part of the abstracts to search in "Where to search"
  • Search for authors and in the respective field.
  • For planning your conference attendance, please use the conference app, which will be issued some weeks before the conference and the conference agenda provided in conftool.
  • If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.