Monday, February 21, 2022

What should evaluation learn from COP 26? Views of evaluation practitioners

The editor of the journal Evaluation, Prof. Elliot Stern, had an idea to invite a bunch of evaluators working on climate change and related issues to write down their thoughts on the recent UN Framework Convention on Climate Change (UNFCCC) COP26 and its implications to evaluation practice. I was honored to be among those invited to write. The resulting article is available (open access) here on the journal website.

Abstract:

Leading evaluation practitioners were asked about lessons from the recent 26th Conference of the Parties (COP26) for evaluation practice. Contributors emphasize the importance of evaluating equity between rich and poor countries and other forms of climate injustice. The role of the evaluation is questioned: what can evaluation be expected to do on its own and what requires collaboration across disciplines, professions and civil society – and across generations? Contributors discuss the implications of the post-Glasgow climate ‘pact’ for the continued relevance of evaluation. Should evaluators advocate for the marginalized and become activists on behalf of sustainability and climate justice – as well as advocates of evidence? Accountability-driven and evidence-based evaluation is needed to assess the effectiveness of investments in adaptation and mitigation. Causal pathways in different settings and ‘theories of no-change’ are needed to understand gaps between stakeholder promises and delivery. Evaluators should measure unintended consequences and what is often left unmeasured, and be sensitive to failure and unanticipated effects of funded actions. Evaluation timescales and units of analysis beyond particular programmes are needed to evaluate the complexities of climate change, sustainability and to take account of natural systems. The implications for evaluation commissioning and funding are discussed as well as the role of evaluation in programme-design and implementation.

Confronting Storms, Fires, and Pestilence: Meaningful Evaluation for a Hazardous World

The world as we know it would appear to have suddenly become more hazardous than ever before in our living memory. This may not actually be so considering the entire hazardscape, but the types of societal threats have changed. The sweet complacency of the affluent West has been disrupted. Instead of history ending in an unstoppable march of globalisation and economic growth, we are suddenly faced with natural and social calamities that threaten the sustainability of our common future. 

Before looking at the role of evaluation in development and transformational change, the root causes of destruction are examined, along with the maldistribution of the repercussions of this destruction. It is argued that evaluation must take a broad view within a complex system that includes the natural environment if it is to make a contribution to a world that is socially, economically, and environmentally sustainable.

The full article is available (open access) in the journal Evaluation Matters—He Take Tō Te Aromatawai 7:21.