Institutional Learning and Change Initiative

The following text is drawn from ISNAR (2003).

Traditional peer review involves the assessment of the quality (scientific merit) of the research by scientific experts (peers) in the specific research field. Modified peer review on the other hand involves combining some form of socio-economic impact assessment with traditional peer review. This is accomplished by inlcuding non-peer members in the expert group such as economists, social scientists, civil servants, extension staff, NGO representatives, farmer representatives, etc.

The most common structure of a modified peer review involving scientific peers and socio-economic experts is that the two reviews are carried out independently and the results are then brought together in an integrated report by a third party. Sometimes, however, the assessments of the scientific peers are provided to socio-economic experts, who then take these options into consideration in carrying out their own review.

Modified peer reviews often take the form of a basic questions and aswer format - facilitated by interview techniques. The method can also involve iteractive discussion process to reach a consensus.

Weakness of Modified Peer Review
The major weakness of modified peer review is that generally a small number of individuals are involved, and, as a result, it is difficult to gather a sufficiently broad base of knowledge to credibly comment on the economic and social impacts of the R&D activities.

Suitability of Modified Peer Review
This method is equally well suited for assessing R&D carried out in the past, on-going R&D, and R&D that are being considered for the future.  The method can be used for basic, strategic as well as applied R&D activities.  It is most useful for assessing R&D projects and programs and not particularly useful for assessing larger R&D activities, i.e., national level allocation of resources within agriculture.
 

Source: ISNAR (2003) Monitoring, Evaluation, and Impact Assessment of R&D Investments in Agriculture, The Hague: International Service for National Agricultural Research.