- Home
- About us
- ILAC Activities
- Resources
- ILAC Publications
- ILAC Briefs
- ILAC Sourcebook
- Part 2 - Tools and approaches
- Chapter 6: Introduction Part 2
- Chapter 7: Innovation histories
- Chapter 9: Culture study as a tool for change
- Chapter 12: Collaborative agreements
- Chapter 13: Facilitation as a foundation skill for ILAC
- Chapter 14: Learning alliances
- Chapter 15: Institutional histories
- Chapter 16: Engaging Scientists through Institutional Histories
- Chapter 18: Horizontal evaluation
- Chapter 19: Appreciative inquiry
- Part 3 - Cases and experiences
- Part 4 - Challenges and strategies
- About the authors
- Glossary
- References
- Part 2 - Tools and approaches
- Presentations by ILAC Team
- Working Papers
- Journal Articles
- Newsletter
- Reports
- ILAC Library
- Tools and methods for M&E
- Appreciative inquiry
- Biophysical measurements
- Case study
- Content analysis
- Contribution analysis
- Cost-Benefit Analysis
- Creative expression
- Diaries, journals and logs
- Dreams realised or visioning
- Expert review
- GIS mapping
- Graphing results
- Group assessment
- Historical trends and timelines
- Horizontal evaluation
- Impact evaluation
- Benefit-cost methods
- Case studies
- Cost-effectiveness analysis
- Counterfactual Impact Evaluation (CIE)
- Difference-in-difference
- Econometric methods
- Ex-post comparison of project beneficiaries with a control group
- Instrumental variables
- Integrated partial indicators
- Mathematical programming
- Modified peer review
- Partial indicators of impact
- Patent analysis
- Pipeline comparison
- Production function approach
- Propensity score matching
- Quasi-experimental design, involving the use of matched control and project groups
- Randomization
- Rapid assessment or review, conducted ex post
- Regression discontinuity design
- Simulation method
- User surveys
- Impact flow diagram
- Innovation histories
- Institutional history
- Institutional linkage diagram
- Interviews
- Learning alliances
- Learning-oriented evaluation
- M&E Frameworks
- M&E wheel (or "spider web")
- Mapping (sketch)
- Matrix scoring
- Most significant change
- Net-Map
- Non-random sampling
- Observation
- Outcome mapping
- Participatory Impact Pathways Analysis
- Participatory methods
- Performance indicators
- Photographs and video
- Problem and objectives trees
- Random sampling
- Ranking and pocket charts
- Rapid appraisal methods
- Relative scales or ladders
- Rich pictures (or mind maps)
- SWOT
- Seasonal calendars
- Semantic differentials
- Social mapping or well-being ranking
- Sociograms
- Stakeholder analysis
- Survey
- Systems (or inputs-outputs) diagram
- Theory-Based Evaluation
- Transects
- Evaluation studies and reports
- Evaluating capacity development
- Partnership
- Seminars
- Video Room
- Links to other sites
- E-learning courses
- ILAC Publications
- Contact
- Blog
Impact Pathway Evaluation; An approach for achieving and attributing impact in complex systems
Sun, 08/31/2008 - 12:52 — Cristina Sette
Publication Type:
Journal ArticleSource:
Agricultural Systems, Volume 78, Number 2, p.243-265 (2003)URL:
http://boru.pbworks.com/f/ag_syst_IPE.pdfKeywords:
Approach; complex; Evaluation; ILAC Newsletter; Impact; Pathway; SystemAbstract:
Agricultural development is fundamentally a social process in which people construct solutions to their problems, often by modifying both new technologies and their own production systems to take advantage of new opportunities offered by the technologies. Hence, agricultural change is an immensely complex process, with a high degree of non-linearity. However, current 'best practice' economic evaluation methods commonly used in the CGIAR system ignore complexity. In this paper we develop a two-stage monitoring, evaluation and impact assessment approach called impact pathway evaluation. This approach is based on program-theory evaluation from the field of evaluation, and the experience of the German development organization GTZ (Deutsche Gesellschaft f?r Technische Zusammenarbeit GmbH). In the first stage of this approach, a research project develops an impact pathway for itself, which is an explicit theory or model of how the project sees itself achieving impact. The project then uses the impact pathway to guide project management in complex environments. The impact pathway may evolve, based on learning over time. The second stage is an ex post impact assessment sometime after the project has finished, in which the project's wider benefits are independently assessed. The evaluator seeks to establish plausible links between the project outputs and developmental changes, such as poverty alleviation. We illustrate the usefulness of impact pathway evaluation through examples from Nigeria and Indonesia.
- Login or register to post comments
- Email this page