The National Science Board (NSB) has been conducting a review of the National Science Foundation's (NSF's) merit review criteria: Intellectual Merit and Broader Impacts. The NSB Task Force on Merit Review has now issued a
draft of the revised criteria for public comment. They have also identified a set of underlying principles upon which the criteria should be based.
In developing the revised criteria, the NSB Task Force looked at reports from a variety of Committees of Visitors reviewing NSF programs, held a large number of conversations and input from stakeholders and members of the impacted communities, and invited public comment on its website. According to NSF and NSB, the various stakeholder groups had very similar perspectives and suggestions. In summary, "It became clear that the two review criteria of Intellectual Merit and Broader Impacts are in fact the right criteria for evaluating NSF proposals, but that revisions are needed to clarify the intent of the criteria, and to highlight the connection to NSF’s core principles."
NSF is now
seeking comment on the principles and revised criteria. Comments should be sent by
July 14, 2011, to
meritreview@nsf.gov. ASPB members are encouraged to offer their reactions and perspectives.
DRAFT FOR COMMENT FROM NSB AND NSF
Merit Review Principles and Criteria
The identification and description of the merit review criteria are firmly grounded in the following principles:
- All NSF projects should be of the highest intellectual merit with the potential to advance the frontiers of knowledge.
- Collectively, NSF projects should help to advance a broad set of important national goals, including:
- Increased economic competitiveness of the United States.
- Development of a globally competitive STEM workforce.
- Increased participation of women, persons with disabilities, and underrepresented minorities in STEM.
- Increased partnerships between academia and industry.
- Improved pre-K–12 STEM education and teacher development.
- Improved undergraduate STEM education.
- Increased public scientific literacy and public engagement with science and technology.
- Increased national security.
- Enhanced infrastructure for research and education, including facilities, instrumentation, networks and partnerships.
- Broader impacts may be achieved through the research itself, through activities that are directly related to specific research projects, or through activities that are supported by the project but ancillary to the research. All are valuable approaches for advancing important national goals.
- Ongoing application of these criteria should be subject to appropriate assessment developed using reasonable metrics over a period of time.
Intellectual merit of the proposed activity
The goal of this review criterion is to assess the degree to which the proposed activities will advance the frontiers of knowledge. Elements to consider in the review are:
- What role does the proposed activity play in advancing knowledge and understanding within its own field or across different fields?
- To what extent does the proposed activity suggest and explore creative, original, or potentially transformative concepts?
- How well conceived and organized is the proposed activity?
- How well qualified is the individual or team to conduct the proposed research?
- Is there sufficient access to resources?
Broader impacts of the proposed activity
The purpose of this review criterion is to ensure the consideration of how the proposed project advances a national goal(s). Elements to consider in the review are:
- Which national goal (or goals) is (or are) addressed in this proposal? Has the PI presented a compelling description of how the project or the PI will advance that goal(s)?
- Is there a well-reasoned plan for the proposed activities, including, if appropriate, department-level or institutional engagement?
- Is the rationale for choosing the approach well-justified? Have any innovations been incorporated?
- How well qualified is the individual, team, or institution to carry out the proposed broader impacts activities?
- Are there adequate resources available to the PI or institution to carry out the proposed activities?
Print to Page
Group Home
Blog Home
Group Blogs
RSS