The Call: Transforming Assessment and Evaluation
Glenn Page, SDG Transformations Forum Councillor – Transforming Assessment and Evaluation Working Group and President, Sustainametrix
Over the weekend, I received a “wake-up” phone call with an opening line no parent wants to hear: “Dad I’m in a police car…” With these words, my world changed! I wanted the facts – to be sure, but my raw instinct was to act, whatever it may be. I soon learned all was fine, a wheel had come off his car (long story) and a police detective just happened to be driving by and stopped to offer immediate assistance. But something about those first few words initiated a response mechanism that changed everything. In an instant, I was called to action! I would have done anything to help, support, and provide whatever was needed, regardless. I was ready to go! As I think about the crisis of global biodiversity, wealth inequality, climate disruptions, growth at all costs and rapidly increasing social, ecological and economic debt being transferred to future generations, I wonder why don’t we have the same collective response.
A form of community architecture has recently sprung up. The SDG Transformation Forum is a platform designed for action – not just thinking about the issues but doing something about them. It comes at a time when we know, without question, that our species is shaping the future of life support systems we depend upon. The SDGs are probably the best expression of global governance we have, now codified as collective response to the mess we have been making. The Forum both appreciates and celebrates the SDGs, but also identifies that their pursuit needs a new mindset, different from that which created the current situation. In the name of goal attainment, the devil is in the details of how we do it. Attainment of all the laudable social and economic goals (SD Goals 1-11) without transforming the short-term focus of economic growth as the ultimate objective will prevent attainment of ecosystem goals of climate and life on land and below the water (SD Goals 13-15).
“We are called to be architects of the future, not its victims. [The challenge is] to make the world work for 100% of humanity in the shortest possible time, with spontaneous cooperation and without ecological damage or disadvantage of anyone.” –R. Buckminster Fuller
Following this edict from Bucky Fuller won’t be easy. For starters, we need to make sure our measurement of progress does not fall into the trap of quantitative analysis left only to the statisticians and methodologists. We envision a more inclusive and intuitive approach rooted in integration and synthesis across the goals, high degree of participation with holistic thinking that respects the non-linear, interrelated and complex realities that exist across scales. This is messy work! Pushing us further, we need to ground thinking in values that undergird the SDG’s in the first place: to be architects of a transformative future! As Robert Picciotto wrote in a 2015 article on Development Evaluation in Transition: “in an uncertain world, where uncertainty prevails and change is the only constant, ethical values, more than pre-determined outcomes drives decision-making.”
Thus, we believe that evaluation and assessment itself must be transformed. That is an overarching philosophy that is guiding the Forum’s Assessment and Evaluation Working Group. The Group is gaining real interest from folks who have developed stellar careers in the field of systems thinking, complexity theory and evaluation. Together we are recognizing major challenges given linear logic and the illusion of control dominates assessment and evaluation of SDG’s. Pathways to both sustainable growth and poverty reduction are not linear and context free, they depend on many factors. Notably surprises, unintended consequences, butterfly effects and disruptions all which requires paying attention to, patterns through feedback and adaptive learning. This opens a window for scaling up the relatively recent growth of developmental evaluation and principles-focused evaluation to address issues of global systems change.
As Picciotto further notes, “this will require a more adventurous approach… well beyond the programme evaluation approach that has dominated it.” Zenda Ofir agrees! Zenda, a gifted writer, independent evaluator and former president of the African Evaluation Association and a member of this working group believes we need to evolve the profession, and countries still known as the “Global South” may provide fertile ground to jump start the process. There is a growing awareness of the urgent need to think differently about sustainable development and its evaluation. Think leap-frogging past landlines to cellphones; we need to seek the evaluation equivalent.
What started with a face-to-face meeting in early September in Scotland, our SDG Transformations Working Group has generated a DRAFT manifesto and two webinars and the early stages of an action agenda. What began as a small group of five people, has engaged over a hundred people who are interested in what is needed to transform the nature of assessment and measurement to better respond to global systems change. And this is only the beginning!
This work comes at a time when the field of evaluation is rapidly evolving. One of the working group members is Michael Quinn Patton who has built a distinguished career as a forefather in the field of evaluation pushing its envelope towards usefulness. Just now, if you are in a remote corner of the winter woods of Minnesota and you listen closely, you may just hear his keyboard chattering away as he writes the “Blue Marble” perspective. This book is not like the others as it is as much for global leaders as it is for evaluators. It’s as much about the design of our response to large-scale systems change as it is about measurement strategies. He is offering a systematic approach, rooted in evaluative thinking, principles focused evaluation and developmental evaluation. It’s about adaptive learning and collective response that is rooted in individual competencies as well as collective competencies.
The name “Blue Marble” comes from a famous photo that was shot in 1972 during a formative time in our relationship with our home planet. Blue Marble is not a method, but a perspective that we believe is needed for marking progress with SDGs. Our working group is now at the earliest stages of developing an action strategy to define what may be needed to transform the process of assessment and measurement for SDGs. We believe that if the “evaluation system” is better understood, we can more effectively understand major gaps, discrepancies, inefficiencies, hindrances and enablers to effectiveness. This is ambitious!
One estimate puts the number of evaluators world-wide at 32,000. This number is dwarfed by the total number of accountants, auditors, management consultants and statisticians. The opportunity for high quality Blue Marble-type evaluation as a leadership function is upon us. This is consistent with the clarion call of Global Evaluation Agenda, drawn up in 2015 by EvalPartners and International Organization for Collaboration in Evaluation (IOCE). It requires transformative education of evaluation professionals, guiding principles rooted in competencies for the individual and for collective action. It requires serious rethinking of the role, promise and limitations of evaluation as practice in service of the world.
Ultimately, if the global evaluation system is to serve the needs of people, ecosystems and the planet, we need to understand and help enable its evolution. A focus on SGD’s is a major starting point. We are all receiving “wake-up” calls every day. For me, the real wake-up is not from a call from my son’s cell phone but from a world with a perfect storm of challenges and the slow the pace of collaborating across borders, across sectors, across disciplines toward shared global goals! The question remains: how are we responding? If you are interested in transforming how we mark progress with SDG’s – come join us.