Listing

All publication titles in alphabetical order

• A measure of community members' perceptions of the impacts of research partnerships in health and social services
  Glaser, J.; King, G.; Servais, M.; Kertoy, M.; Specht, J.; Currie, M.; Rosenbaum, P.; Law, M.; Forchuk, C.; Chalmers, H.; Willoughby, T. 2009
  A scientific paper introducing a survey questionnaire measuring community members' perceptions of the impact of research collaborations addressing health or social issues.
• A review of current Australian and international practice in measuring the quality and impact of publicly funded research in the humanities, arts and social sciences
  Donovan, C. 2005
  A review describing current practice in measuring the quality and impact of publicly funded research in the humanities, arts and social sciences.
• A review of health impact assessment frameworks
  Mindell, J.S.; Boltong, A.; Forde, I. 2008
  A review of health research assessment frameworks
• A tool for assessing research quality and relevance
  2006
  A policy document by the Danish Council for Research Policy presenting a tool to assess and compare quality and relevance of Danish research across research areas and research institutions.
• AHRC evaluation strategy 2007-2012
  
  A policy document by the Arts and Humanities Research Council (UK) presenting rationales to develop and evaluation strategy.
• American evaluation association: guiding principles for evaluators
  2009
  An ethical guideline by the American Evaluation Association , to promote ethical practice in the evaluation of programs, products, personnel, and policy.
• An evaluation of the Cambridge-MIT institute
  Simmonds, P.; Stroyan, J.; Clark, J. 2009
  A report by Technolpolis presenting findings from an evaluation of the Cambridge-MIT Institute (CMI). The core of the study has been the evaluation of the economic benefits accruing a specific theme of the Cambridge-MIT Institute (CMI) programme.
• An Overview of the two oldest national evaluation systems for university research
  Glaser, J.; Jansen, J. 2009
  A paper comparing the world's two oldest systematic evaluation systems of university research (UK & The Netherlands). Their comparisons, similarities and changes over time are discussed.
• Approaches to research and development performance assessment in the United States: an analysis of recent evaluation trends
  2006
  A scientific paper analyzing recent trends associated with performance assessment and evaluation in US government R&D agencies.
• Asessing the economic and social impacts of publicly funded research
  Tang, P.; Molas-Gallart, J. 2008
  A review document on studies that have attempted to assess the economic and social benefits from publicly funded research. In particular, the document focus on these benefits that have accrued from Big Science projects.
• Assessing the impact of England's National Health Service R&D health technology assessment program using the
  Raftery, J.; Hanney, S.; Green, C.; Buxton, M. 2009
  A scientific paper discussing the impact assessment of a health technology assessment program using the 'payback' framework.
• Assessing the impact of research:
  Melis, E. 2007
  A report presenting the results of a multi case study project concerning different methods that are available to assess the impact of research the Dutch Cancer Society.
• Assessing university research: a plea for a balanced approach
  2007
  A scientific paper arguing that metrics cannot replace peer review, but can make the evaluation process more efficient and cost-effective when used complementary to peer review.
• Benchmarking university-industry research cooperation worldwide: performance measurements and indicators based on co-authorship data for the world's largest universities
  2009
  A scientific paper presenting comparative information as to which of the world's 350 largest research universities are the world's major providers of science-based information and services to the business sector in general and research-active industry in particular.
• Benchmarking university-industry research cooperation worldwide: performance measurements and indicators based on co-authorship data for the world?s largest universities
  Tijssen, R.J.W.; Leeuwen, T.N.; Wijk, E. 2009
  A scientific paper presenting the results of a statistical analysis of the world's 350 largest research universities to identify which universities are among the world's major providers of research-based information and services to the business sector in general, and science-dependent industry in particular
• Bridging research and policy: Context, evidence and links
  Crewe, E.; Young, J. 2002
  Unpublished work appraising current models of knowledge utilisation and policy making, as well as other literature that sheds light on the research/policy linkages, especially concerning development research.
• Capturing research impacts: A review of international practice
  2010
  A report commissioned by the Higher Education Funding Council for England, reviewing approaches to evaluating the impact of research and to identify relevant challenges, lessons and observations from international practice. The report is based on four case studies.
• CPB Memorandum: De maatschappelijke opbrengsten van wetenschappelijk onderzoek: Een Literatuuroverzicht
  Venniker, R.; Canton, E. 2004
  A review document discussing empirical knowledge about the effects of publicly funded scientific research on productivity, patents, innovations and new enterprises, and the relationship between public and private research
• De maatschappelijke impact van gezondheidsonderzoek
  Burdorf, A.; Pluijm, S.M.F.; Langeveld, C.H.; Bensing, J.M.; Bouter, L.M.; Maas, P.J. van der; Mackenbach, J.P. 2009
  A paper presenting mainly qualitative indicators to map efforts of researchers to disseminate knowledge to practice and to map actual application of this knowledge in health care.
• Demonstrating and communicating research impact: Preparing NIOSH programs for external review
  Williams, V.L.; Eiseman, E.; Landree, E.; Adamson, D.M. 2009
  A report by RAND Corporation about the development and application of a logic model based framework for conducting external reviews of the impact of the research programmes of the US National Institute for Occupational Safety and Health.
• Developing the protocol for the evaluation of the health foundation's 'engaging with quality initiative'- an emergent
  Soper, B. ; Buxton, M.; Hanney, S.; Oortwijn, W.; Scoggins, A.; Steel, N.; Ling, T. 2008
  A scientific paper describing the development of a protocol for the external evaluation of the social impact of eight health research projects.
• Dutch experience
  Meulen, B. van der; Rip, A. 2000
  A scientific paper exploring Dutch thinking about the issues, tools and practices of evaluation, with special reference to societal quality. Indicators are identified and positioned through the review of 17 evaluation processes in the Netherlands. The context for the review process is examined.
• Enhancing research collaborations: Three key management challenges
  Bammer, G. 2008
  A scientific paper on research collaborations, focussing on management lessons and evaluation issues
• Evaluating universities using simple scientometric research-output metrics: total citation counts per university for a retrospective seven-year rolling sample
  2007
  A scientific paper arguing for a a scientometric, top-down and institution-based research-assessment methodology that is based on total citations accumulated from all publications associated with a specific university.
• Evaluation of large research initiatives: Outcomes, challenges, and methodological considerations
  Quinlan, K.M.; Kane, M.; W. M. K. Trochim 2008
  A bookchapter containing relevant literature and findings of evaluations of four large-scale, federally funded scientific research programs in the United States to identify desired outcomes of these types of programs, major evaluation challenges, and methodological principles and approaches.
• Evaluation of the valorisation activities of the Netherlands Genomics Initiative (NGI)
  Boekholt, P.; Meijer, I; Vullings, W. 2007
  A report by Technolopolis presenting first the results of the evaluation of its valorisation activities of the Dutch Genomics Initiative and second recommendations for the future development of valorisation activities. An impact assessment was not part of this assignment.
• Excellence in Research for Australia Initiative
  Sheil, M. 2008
  A policy document presenting a broad framework for evaluation of the excellence of research in universities
• Extending citation analysis to non-source items
  2006
  A scientific paper reporting the results of the extension of citation analysis to 'non-source' items
• H index
  
  Wiki entry on the h-index, an index that quantifies both the actual scientific productivity and the apparent scientific impact of a scientist.
• Handreiking: Evaluatie van maatschappelijke relevantie van wetenschappelijk onderzoek
  2010
  A policy document presenting a method for judging academic research on its merits, with a major focus on social relevance. The document is aimed at the organizers of research evaluations and people responsible for self evaluations.
• Higher education rankings: Robustness issues and critical assessment . How much confidence can we have in higher education rankings
  Hombres, B. d’; Saisana, M. 2008
  A policy document on the development of a European academic ranking system of universities, as a counterpart to the Sjanghai and THES rankings.
• ICT assessment: Moving byond journal outputs
  Butler, L. 2008
  A scientific paper describing how to rank ICT conferences into prestige tiers and how to implement these rankings in research assessment.
• Identifying the impact of diabetes research
  Hanney, S.R.; Home, P.D. ; Frame, I.; Grant, J.; Green, P.; Buxton, M.J. 2005
  A scientific paper about the assessment of the social and economic impact of a body of diabetes research published in 1981 and the identification of factors behind success.
• Impact assessment geesteswetenschappen
  Nijssen, A. 2009
  A report commissioned by the Dutch Council for humanities introducing a method to assess societal impact of the humanities, using a number of indicators.
• Impact evaluation of Finnish programmes for centres of excellence in research 2000-2005 and 2002-2007
  Hjelt, M.; Ahonen, P.P; Pessala, P. 2009
  A report by the Academy of Finland on the societal impacts of the Finnish programmes for Centres of Excellence to define in what way the programmes had promoted the societal objectives and practical impacts set for them in the Center of Excellence strategy.
• Indicatoren en indicaties voor de beoordeling van maatschappelijke kwaliteit van onderzoek ? eindrapport
  
  A report composed of three parts. The first part is on social effects of scientific research and when it should be evaluated. The second provides an overview of potential social quality of research. The third part presents the results of two explorative case studies.
• International expert meeting: 'The evaluation of productive interactions between science and society'
  ERiC – Evaluating Research in Context 2007
  Report of a scientific meeting focussing on the development of a method for social impact assessment of academic research. The proposed method departs from the mission of a research unit and involves stakeholders in the assessment process.
• Judging research on its merits: An advisory report by the Council for the Humanities and the Social Sciences Council
  KNAW 2005
  A report by the Dutch Royal Academy (Council for the Humanties and the Social Sciences Council)advocating the use of discipline specific indicators in research assessments to avoid biases to the natural sciences.
• Key stakeholders' experiences and views of the NHS End of Life Care Programme: findings from a national evaluation
  Kennedy, S.; Seymour, J.; Almack, K.; Cox, K. 2009
  A scientific paper presenting the experiences and views of stakeholders experiences of 37 stakeholders of a health care programme in relation to its development and implementation, impact and sustainability.
• KP7 en het impactcriterium: Aanbeveling voor Nederlandse onderzoekers om met hun projectvoorstellen voor het zevende kaderprogramma beter te scoren op het impactcriterium
  Berg, L. van den 2008
  Report containing recommendiations for Dutch researchers to increase their scores on the research impact criterium of the 7th EU Framework Program.
• Laboratory activity profiles: an exploratory approach
  Larédo, P.; Mustar, P. 2000
  An article proposing a method for characterizing ?the activity profiles? of research laboratories by using a number of simple indicators.
• Linking between Danish universities and society
  2009
  A scientific paper presenting case studies of third mission perception and implementation by two young Danish universities.
• Maatschappelijke impact van gezondheidsonderzoek
  Ark, G. van; Klasen, E.C. 2007
  A scientific paper presenting a framework to 'measure' social impact of the entire field of health studies; from fundamental to applied.
• Making team science better: applying improvement-oriented evaluation principles to evaluation of cooperative research centers
  Gray, D.O. 2008
  A book chapter arguing that although recent CRC evaluation efforts have gone a long way toward meeting the needs of groups interested in accountability, they do little to meet the needs of inexperienced scientist managers who try to lead and manage these organizationally complex initiatives. An exception to this trend is described: the improvement-oriented evaluation strategy pioneered by the National Science Foundation IUCRC program.
• Measures of quality and impact of publicly funded research in the humanities arts and social sciences
  Powles, J. 2005
  A report on how to improve the impact and quality evaluation of research in the Arts, Humanities and Social Sciences The accompanying model can be applied with equal validity across the whole research spectrum.
• Measuring Excellence in Engineering Research
  The Royal Academy of Engineering 2000
  A report presenting in simple terms what is considered to be general priciples for the measurement of excellence in engineering research and how this measurement could be done.
• Measuring the impact of medical research: Moving from outputs to outcomes
  Weiss, A. P. 2007
  A scientific paper in which is argued for an outcomes-based approach to measure return on research investments and describes the steps involved, using an adaptation of the logic model.
• Measuring the impact of research: What do we know? (part I)
  2008
  A scientific paper describing what is known about impact measurement of medical research, to demonstrate accountability and to improve research and programming.
• Measuring the performance of research and technology programs: A balanced scorecard approach
  Jordan, G.B.; Mortensen, J.C. 1997
  A scientific paper describing the social and economic performance measurement efforts of a US technology development program in energy research A strategy for applying this balanced scorecard approach to a fundamental research organization by using logic models of inputs, activities, outcomes and longer research result is proposed.
• Measuring third stream activities. Final report to the Russel group of universities
  Molas-Gallart, J.; Salter, A.; Patel, P.; Duran, X. 2002
  A report setting out to design a system of indicators of third stream activities. Although the development of many of the suggested indicators is at an early stage, the suggested framework could be used to inform university management and government funding decisions.
• New activities of universities in transfer and extension manifold solutions
  2009
  A scientific paper discussing third mission activity strategies of universities in different countries and the new balance between education, research and transfer/extension these institutions have to find.
• New exploratory work of evaluating a researcher's output
  Junping Qiu; Ruimin Ma; Ni Cheng 2008
  A scientific paper describing an additional index to the h-index, to evaluate and compare outputs of researchers among fields and to be able to evaluate outputs of young researchers.
• Peer review and the relevance gap: ten suggestions for policy-makers
  2007
  A scientific paper exploring what can be done to close the gap between the research that society requires and the research that science produces.
• Publish or perish? The value of Google Scholar for extended impact monitoring
  Harzing, A.W.
  
• Quality assessment in the design and engineering disciplines: A systematic framework
  2010
  On request of the three Dutch technical universitities, the Royal Netherlands Academy of Arts and Sciences wrote an advisory report on how to adequately assess the quality of technical and constructing sciences. The report advocates for differention in the assessment of different fields. The report presents a method using two types of assessment criteria; scientific quality and societal relevance. The field-dependent fine tuning is based in the indicators that are used to determine whether research proposals, individuals or research groups meet the criteria of scientific quality and societal relevance.
• RAE 2008 Guidance on submissions
  Hughes, E. ; Madden, D.; Linton, J. 2005
  Policy document specifying the content and data requirements for submissions in the 2008 Research Assessment Exercise and guides higher education institutions on policy and practical matters in preparing submissions.
• Research impact: A cross sector literature review
  Walter, I.; Nutley, S.; Davies, H. 2003
  An unpublished literature review document providing an overview of the literature on approaches to enhancing research use(in terms of impact and effectiveness) from the education, healthcare, social care and criminal justice sectors.
• Research prestatiemeting: een internationale vergelijking
  Jongbloed, B.; Salerno, C.; Huisman, J.; Vossensteyn, H. 2005
  A report to the Dutch Ministry of Science describing the different ways Australia, the UK, Germany, Flanders, Norway and New Zealand monitor academic research of universities.
• Research quality framework: Assessing the quality and impact of research in Australia
  2005
  A policy document by the Australian Government introducing the Research Quality Framework (RQF) to provide a consistent and comprehensive approach to assessing the quality and impact of publicly funded research. An RQF, when developed, may be the basis for future allocations of research funding. (due to a change in government, the RQF has not been used in practice).
• RMO publicaties en hun gebruikers. Een kwantitatieve analyse van gebruik en gebruikers van het werk van de Raad voor Maatschappelijke ontwikekling 2005-2008
  Prins, A.A.M 2008
  A report introducing a new method to study the diffusion of research results into the public domain and to identify hidden knowledge users.
• RTD Evaluation Toolbox
  Fahrenkrog, G.; Polt, W.; Rojo, J.; Tubke, A.; Zinocker, K. 2002
  A report by the European Commission that provides the state of affairs in methodologies for evaluating the socioeconomic impact of Research and Technological Development (RTD) policies and their contribution to the policy-making process.
• Scientists who engage with society perform better academically
  2009
  A scientific paper studying the relation between researcher's social engagement and their scientific performance.
• Some useful methods for measuring the benefits of social sciences research
  Kilpatrick, H.E. Jr. 1998
  A scientific paper discussing especially overlooked ways to measure returns of policy oriented research in the social sciences.
• Standard Evaluation Protocol 2009-2015. Protocol for research assessment in The Netherlands
  KNAW; VSNU; NWO 2009
  Dutch national protocol for the assessment of academic research at universities and public research institutes.
• Testing novel quantitative indicators of research ??quality?, esteem and ?user engagement?: an economic pilot study
  Donovan, C.; Butler, L. 2007
  A scientific paper reporting the outcomes of a comparative pilot study of five Australian economics departments which tested data produced using novel bibliometric, esteem, and ?user engagement? measures.
• The assessment of research quality in engineering disciplines
  The Royal Academy of Engineering
  A policy document by the UK Royal Academy of Engineering proposing an 8 step method to assess research quality of engineering disciplines, using activity profiles.
• The Ceres (and EADI) system of valuation of research output
  Vlak 2007
  Policy document presenting a balanced system of research time valuation, that fits the broad social science cultures in which members of a research school for resource studies for development.
• The future of research evaluation rests with an intelligent combination of advanced metrics and transparent peer review
  2007
  A scientific paper discussing the strengths and limitations of metrics and peer review in large scale evaluations of scholarly research performance.
• The impact of the University of Cambridge on the UK economy and society
  2006
  A report by Library House on the impact of the University of Cambridge (the University or Cambridge). The authors developed a free available method to examine the direct and indirect economic and societal impacts of the two principal activities of any university: teaching and research. Societal impact is less complete in terms of identification and quantification.
• The Logic Model for Program Planning and Evaluation
  McCawley, P.F.
  Unpublished academic work discussing the logic model. The model describes logical linkages among program resources, activities, outputs, audiences, and short-, intermediate-, and long-term outcomes related to a specific problem or situation. Once a program has been described in terms of the logic model, critical measures of performance can be identified.
• The logic of research evaluation
  2008
  The authors offer suggestions about logical distinctions often overlooked in the evaluation of research, beginning with a strong plea not to treat technology as applied science, and especially not to treat research in technology as important only if it makes a contribution to scientific knowledge. They argue that the frameworks illustrated in this issue for the evaluation of technology centers and their research are superior to those used for evaluating science centers. Ways to improve the evaluation of research are suggested.
• The qualitative future of research evaluation
  2007
  A scientific paper arguing for the use of qualitative indicators for their better fit to the evaluation of economic objectives, compared to quantitative indicators.
• The returns from arthritis research: a report prepared by RAND Europe for the Arthritis Research Campaign
  Wooding, S.; Hanney, S.; Buxton, M.; Grant, J. 2004
  A report presenting the evaluation, and output and outcomes of 16 arthritis research programmes.
• The societal impact of applied health research. Towards a quality assessment system
  Council for Medical Sciences 2002
  A report by the Council for Medical Sciences of the Dutch Royal Academy representing a general outline for an evaluation methodology of societal impact of applied health research, including potentially suitable indicators, as a basis for further specification and development.
• The UK research assessment excercise: the evolution of a national research evaluation system
  2007
  A scientific paper discussing the history of the UK research assessment exercise; a national research evaluation system used to allocate financial resources.
• Toward a theory of stakeholder identification and salience: defining the principle of who and what really counts
  Mitchell, R.K.; Agle, B.R.; Wood, D.J. 1997
  A scientific paper presenting a theory of stakeholder identification and salience based on stakeholder possessing one or more of three relationship attributes: power, legitimacy, and urgency. Furthermore, by combining these attributes, a typology of stakeholders is generated as well as, propositions concerning their salience to managers of the firm, and research and management implications.
• University research centers and the composition of research collaborations
  Boardman, P.C.; Corley, E.A. 2008
  A scientific paper estimating whether institute-level measures of research capacity and structure affect institute affiliated university scientists' and engineers' collaborative behaviors