iPhone app iPad app Android phone app Android tablet app More

Featuring fresh takes and real-time analysis from HuffPost's signature lineup of contributors
Jonathan Lewis

Jonathan Lewis

GET UPDATES FROM Jonathan Lewis

Measuring Your Money's Impact

Posted: 05/ 9/11 06:00 PM ET

I have doubts that social scientists, scholars, foundation executives, impact investors and government managers are ever going to be happy. Their latest angst shows up in a myriad of projects and books which purport to meaningfully measure social investing in the developing world.

As repeatedly extolled, it seems that private sector investors are demanding that social investments not only make money, but also (really, no kidding) actually do good as well. The dream is that buckets of new money to finance the end of poverty will be forthcoming, if social investors could track their good deeds with the same ease that they track their deeds of trust.

Market capitalists measure success simplistically -- by financial returns, market share and stock price. If products or services incidentally advance the public welfare, all the better; if not, oh well. For investors, the metric that matters is in profit margins, not social missions.

Social entrepreneurs, however, evaluate performance across a nuanced set of metrics. They serve multiple stakeholders, all motivated by complex standards of community justice and ideals about the human condition. They lead us towards what we should measure, not what we can measure.

Consider a neighborhood newspaper anywhere in the world. Computing the value of a newspaper based on its circulation and advertising revenue produces its valuation, not its full value. A newspaper is a commercial venture, but also a social asset with a vital role in advancing free speech and fostering community cohesion. If we could measure the impact of free speech, and a particular newspaper came up short on our free speech analytics, what is the remedy? Defunding it?

A more immediate example is microfinance. Some celebrity academics have concluded that microfinance is not working as well as promised. With 190 million impoverished micro-borrowers voting with their wallets by renewing microloans every day, donors and social investors are understandably scratching their heads. Microcredit borrower's personal loan ledger (photo credit: Jonathan C. Lewis):

Microfinance has been horrendously oversold. Nearly all charitable fundraising (and corporate ad campaigns) over-promise -- it happens.

The pain of poverty is no less real, so the ethical challenge for every global citizen is, "What are the pragmatic, actionable choices?"

For starters, we can accept, without cynicism, that the poor, like you and I, are irrational economic actors who sometimes make short-term decisions to their long-term detriment. The difference is, only the poor are likely to get defunded for it by discouraged donors and social investors.

Let's avoid allowing the measurement mafia, even when motivated by good intent, to inflict a kind of hegemony over social change. We should insist the microfinance researchers conduct a randomized controlled trial (the presumed gold standard of social science) to tell us if poor women are better off without any opportunity to earn money for themselves.

We should evaluate the evaluations. Are the studies flawless and worthy of academic tenure or are they themselves over-promising? Can we rely on them for social investment decisions? Economic development and scholarly research alike deserves scrutiny.

Let's not target our dollars at only what we can document, instead of what we can dream.

 
 
 
  • Comments
  • 8
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Recency  | 
Popularity
01:11 PM on 05/18/2011
Nice piece, Jonathan. You're right, we don't need to measure stuff to death, and undiscerning metrics nazis threaten to make measurement into an unproductive hassle. It doesn't have to be that way, though. If everyone in the in the social sector just measured the one thing that best captures progress on the mission, we'd be in a very different place. Measurement needs to be simple enough to do and rigorous enough to mean something. In some cases, it way be good enough to simply measure a before and after; other times you need to compare to something, and occasionally you need the full randomized controlled trial. Overall, we rather see metrics that feed into ongoing operations that outside studies that provide only a snapshot in time. We think that if you 1) know exactly what you're trying to accomplish, 2) pick the right indicator, 3) collect good quality data, and 4) make the case that it was our doing that created the change, then you probably have done a good enough job.
photo
HUFFPOST BLOGGER
Jonathan Lewis
Founder/Host, iOnPoverty
03:15 PM on 05/24/2011
Excellent points, Kevin. The key in my mind is that your approach makes evalution a management tool for improvement, not a "gotcha metric." Cheers.
04:04 AM on 05/18/2011
"I am for accountabi­lity, but I am against cramming the human experience into compartmen­ts and book chapters. Sometimes, indeed oftentimes­, civilized progress is fragile, unpredicta­ble and immeasurab­le." Thank you Jonathan for your important challenge to the divisive yet growing discourse that masks top down development as accountability. Who says that the poorest of the poor, the working poor, the marginalized need an externally imposed system of evaluation! There is no system as powerful in ensuring transparency, accountability and yes, in fact, impact as the active participation, trust and confidence of the beneficiaries, members, constitutencies that poverty alleviation programs seek to serve. I dream of a time when the measurement mafia will take its cues and learn from the lessons from the grassroots! And be awed, as I am daily, at the rigor, innovation and purposefulness with which people with few resources make social transformation possible!
photo
HUFFPOST BLOGGER
Jonathan Lewis
Founder/Host, iOnPoverty
03:19 PM on 05/24/2011
I am inspired by your insight and thoughtfulness. Of course, all of us working towards a fairer, more decent world serve many stakeholders and therein lies the rub. What a funder demands may not be what a community asks. Life is complicated.
11:22 AM on 05/10/2011
There are many ways in hindsight to evaluate the effectiveness of any investment, whether it is social impact, environmental, developmental or financial. It’s actually the investor who needs to set the bar for success or failure. When the investment is made, the investor, whether an individual, organization or government entity – the deliverables of that investment should be identified along with how outcomes will be measured.

We can all agree or disagree about the social impact – whether good or bad. Much is subjective to the outsider. However, the investors know what they seek. I’ve worked in different cultures and countries, in both private and public projects. I managed a project for two wealthy families in Turkey who wanted a private hospital as a “social investment”. They saw making money from wealthy patients as a way to subsidize care for those who could not afford the going rates, and some discounts went as far as 90%, some were given away. In the end, the hospital still made a small project and to some outsiders, it was still seen as a hospital for the rich. The investors made much less money on this investment than they made on their regular business ventures so they saw this as a “social investment.”

Beauty is in the eye of the beholder, as are social investments.
photo
Randall Kempner
Executive Director, Aspen Network of Development E
01:05 AM on 05/10/2011
Jonathan,

It seems you only see the challenges of improved measurement of social and environmental impact. But what about the upside?

You are right that the focus on metrics could drive an overly-doctrinaire approach that leaves some worthy efforts unfunded. But, with transparent, high quality, and comparable impact data, we may be able better direct exisitng investment to higher-impact projects. More importantly, we may unlock significant amounts of additional capital (millions? billions?) aimed at making the world a better place. I'm convinced that some potential impact investors are sitting on the sidelines precisely because present efforts at measurement are inconsistent and uncertain.

Measurement of social and environmental impact will always be difficult and somewhat messy. But nascent efforts like the Impact Reporting Investment Standards (IRIS) are trying to povide data that will allow global citizens to do exactly what you seek -- make (better) pragmatic, actionable choices about which programs or investments to support.

We're in the early days of developing and driving standards for impact assessment. We practitoners may, as you suggest, never be happy. But we should at least give it a shot.
photo
HUFFPOST BLOGGER
Jonathan Lewis
Founder/Host, iOnPoverty
12:15 PM on 05/10/2011
Randall, thanks for your reasonable and hopeful comments. You speak for the many good people who are sincerely attempting to build a lighthouse to warn social investors off the shoals of ineffective and hyped economic development.

However, I do not see any evidence whatsoever to support the contention that vaults and vaults of additional social capital is waiting to discover its soulful investment purpose if ONLY decent techniques to measure impact existed. Quite the opposite. The fledging academic efforts to measure microfinance’s impact are generating a cynicism (“nothing works”) among current social investors and donors, not unleashing new money. Indeed, I think the main economic benefit from the measurement and metrics crowd may be consultant job creation here in the West.

It seems axiomatic to me that enduring economic development is grounded in changing human behavior – educating, e.g, a young girl about her rights, family planning, etc. In the town of Sidi Bouzid, Tunisia, where Mr. Bouazizi burned himself to death and launched the Arab Spring, is an economic development organization called Karama. Its frontline multi-sectoral approach recognizes the layered complexity of social change. To justify itself to scholars and funders in the West, Karama would be shrewd to pick metrics that it could unquestionably quantify (and achieve!). But in Arabic Karama means “dignity” and dignity is hard to measure.

I am for accountability, but I am against cramming the human experience into compartments and book chapters. Sometimes, indeed oftentimes, civilized progress is fragile, unpredictable and immeasurable.
08:34 PM on 05/09/2011
David Suzuki is Canada’s green guru. He just turned 75. For the last 50 years, he has been the voice of environmentalism. For most of that time, he has hosted the program, “The Nature of Things” which every Canadian knows and loves. Two weeks ago the Globe & Mail ran a multi-page reflection/interview on his life. One thing he said caught my attention: The Green Party (a Cdn political party) may have done more harm than good to environmental concerns. Suzuki's reasoning: By ghettoizing green into a political party one may let everyone else off the hook. Environmental care and concern ought to permeate every political, corporate, and personal decision.

I have felt similarly about impact investing. If we create an impact investing industry, or call for the creation of an impact asset class, we may kill our core impact values. Social impact should not be the domain of an asset class, nor an association, nor an industry. It should not be a 5% portfolio allocation. Impact is a reflection of who we are as a society. It will, if society continues to deepen its values, permeate every capital decision anyone makes. And that is about a lot more than metrics or measurement or bragging.

Our capital is us. 100% of capital is allocated to our values; maybe our values are only 5% what we say they are.

I am a fan of GIIN because GIIN can be the nexus of a conversation.