Session Information
12 SES 04, Network Session 04
Paper Session plus Network Meeting
Time:
2008-09-10
16:00-17:30
Room:
A1 314
Chair:
Peter K. P. Meyer
Contribution
The focus of this EU project, European Educational Research Quality Indicators (EERQI), is a collaborative, evidence-based effort to develop new indicators and methodologies which can be used to determine research quality of scientific publications and, in turn, research results and their means of dissemination. This affects not only the impacts of research efforts and scientific publications, but also the policies of research funding bodies and assessment boards, national higher education and research councils and at the European level, the policies and programmes on scientific advancement and research orientation.
Traditional methods of assessing research quality of scientific publications have depended heavily on ranking methods according to citation frequency and journal impact factors, both of which are based on an instrument which does not reflect adequate coverage of European scientific publications. Hence, if European science policy makers, journal editors, hiring bodies and other evaluation bodies and/or institutions rely on this type of evaluation method, individual researchers, institutions, certain subject domains, and even complete language areas are disadvantaged, as they are not – or only sparsely – included in the scope of this instrument.
The initiators of the EERQI project, as well as many other scientists and evaluation bodies in the European Union region, recognize the need to remedy the inadequacies of this situation by providing such a prototype framework for expanding these research quality indicators. The EERQI project pro-poses an evidence-based prototype framework that relies on new knowledge about how quality and relevance in research publications can be determined using new indicators, as well as on new tech-nological possibilities provided by natural language processing tools for content analysis and extrac-tion as well as for text mining of digitally-available scientific documents. Thus, taking advantage of contextual relationships, the traditional quantitative indicators based on citation counts and ranking will be complemented by quality indicators in a framework model which can be used to support all aspects of scientific policy.
The project starts in April 2008. The paper will report on the design and detailed work plan of the project.
Expected Outcomes
prototype of a technical framework for the assessment of quality of scientific publications based on new indicators applied on digital content
References
Botte, Alexander: Achievement or performance: observation of productivity of educational research by bibliometric tools. A state-of-the-art-report. 10p. Paper presented at the European Conference on Educational Research, University of Crete, 22-25 September 2004 URL: http://www.leeds.ac.uk/educol/documents/00003714.doc URL2: http://www.leeds.ac.uk/educol/documents/00003714.htm
Search the ECER Programme
- Search for keywords and phrases in "Text Search"
- Restrict in which part of the abstracts to search in "Where to search"
- Search for authors and in the respective field.
- For planning your conference attendance you may want to use the conference app, which will be issued some weeks before the conference
- If you are a session chair, best look up your chairing duties in the conference system (Conftool) or the app.