| abstract: |
Assessment of the performance of individual researchers is the cornerstone of the scientific and scholarly workforce. It shapes the quality and relevance of knowledge production in science, technology and innovation. Currently, there is a discrepancy between the criteria used in performance assessment and the broader social and economic function of scientific and scholarly research. Additional problems in the current evaluation system are: lack of resources for qualitative evaluation due to increased scale of research; available quantitative measures are often not applicable at the individual level; and there is a lack of recognition for new types of work that researchers need to perform. As a result, the broader social functions of the scientific system are often not included in its quality control mechanisms.
Academic Careers Understood through Measurement and Norms (ACUMEN) addresses these problems by developing criteria and guidelines for Good Evaluation Practices (GEP). These will be based on an ACUMEN Portfolio for individual researchers throughout the sciences, social sciences and humanities combining multiple qualitative and quantitative evidence sources. The ACUMEN Portfolio will be based on: a comparative analysis of current peer review systems in Europe; an in-depth exploration of novel peer review practices; an assessment of the use of scientometric indicators in performance evaluation; the development of new web-based indicators and web-based evaluation tools; and a comparative analysis of the implications of current and emerging evaluation practices for the career development of women researchers. ACUMEN is an integrated, comparative study in which a set of proven methods will be used on the basis of selections from one shared data set: a sample of European Research Area personnel from bibliographic and web databases as well as data harvested from websites, and data gathered through interviews and from citation indexes. |
