How Legitimate and Justified are Judgments in Program Evaluation?

Publication Type:

Journal Article

Source:

Evaluation, Volume 15, Issue 3, p.307-319 (2009)

Keywords:

Evaluation; ILAC Newsletter; judgment in program evaluation; legitimate justified judgment

Abstract:

The main function of program evaluations is to describe programs in order to generate judgments of value. To be considered credible, judgments should be both legitimate and justified. The research presented in this article posed the following question: do program evaluation practitioners generate legitimate and justified judgments? A meta-analysis of 40 program evaluation reports was carried out, which found that only 50 percent of the reports generated judgments. While these judgments seemed legitimate, they were rarely justified. However, the elements required to support legitimate and justified judgments were present in the reports in similar proportions, whether the reports generated a judgment or not.
Sublibrary: 
Evaluation