By Kriss Deiglmeier
Every day, we create 2.5 quintillion bytes of data, so much that ninety percent of the world’s data has been created in just the last two years. But data is only valuable if you can do something with it. And, like any tool, data can be used for good or bad.
Making data-informed decisions is nothing new. But the scale of today’s data ecosystem challenges us to think creatively about new ways data can inform our work, policies, and programs. I’m writing to highlight a couple examples that inspired me, and to share tactics that socially-minded organizations and innovators can adopt to tap into data’s potential for good.
Data is easier to acquire and cheaper to store than ever before. This trend is democratizing access to information and increasing transparency between the information haves and have-nots. Data can tell us whether our work is having the impact we desire, reveal patterns, and even predict future needs among vulnerable populations and environments.
However, the immensity, diffusion, and ethics surrounding data are daunting. Data without interpretation is meaningless, yet extracting knowledge can seem intrusive and expensive, requiring skills from social and computer sciences. Some parts of the world are lagging behind the digital divide, without comprehensive legal frameworks to govern data access and storage. We are at a new frontier, navigating uncharted terrain where conflicting priorities around privacy and public good converge.
Crisis Text Line and the Institute of Public and Environmental Affairs have taken different approaches to using data for social impact, each offering its own lessons for our work:
Nancy Lublin founded Crisis Text Line to provide free, 24/7 emotional support for those in crisis. She has trained volunteer counselors around the United States to respond to text messages sent by people in crisis, helping them transition from “a hot moment to a cool calm” in dealing with issues ranging from eating disorders to suicide. In just 2.5 years of operations, Crisis Text Line has processed more than 7 million messages. Their data has volume, velocity, and variety. Patterns in the anonymous texts help Nancy and her team understand user needs and improve their service without compromising privacy.
These patterns can also inform research, policy, and programming far beyond their own organization. According to their website, there has not been a comprehensive study on youth and mental health since 1997. Crisis Text Line launched CrisisTrends.org to help us better understand the crises that Americans face, offering unprecedented insight into where and when these crises occur. This interactive, aggregate dataset can inform the public and the media, shape government and school policies, and drive academic research to help people beyond those who use the Crisis Text Line service.
China has many environmental protection laws, but lax enforcement by state and local governments has hindered their effectiveness. Ma Jun founded the Institute of Public and Environmental Affairs (IPE) in 2006 to gather and analyze publicly available but hard-to-find data on environmental violations across China. His organization makes this data accessible and easy to use, so that press, investors, and citizens can hold suppliers, multinational corporations, and local governments accountable. He and his team have aggregated and analyzed this data to rank multinational brands by their environmental impact and to rank Chinese cities according to their level of environmental information disclosure.
By making data on environmental violations publicly accessible and recently introducing a mobile app to monitor air quality, IPE has empowered Chinese citizens and international consumers to pressure factories into compliance and inspire local regulatory action. IPE also works with companies and factories found in violation to develop more responsible environmental practices. Jun’s work is a great example of how data can be accessed, interpreted and shared to tangibly change the behavior of firms, governments, and individuals.
There are many other examples of innovative uses of data for social impact, from HP Earth Insights’ monitoring of biodiversity in tropical forests, to the United Nations’ tracking global patterns in refugee movement, to Fundación Paraguaya’s mobile data capture to inform its microlending strategy.
Most of us have limited resources for complex data capture or analysis projects. For those yet to prioritize such work, what can we do to move in the right direction?
Despite all its promise, big data is no panacea. Society’s biggest challenges are left to the social sector because markets have failed, legislation is lacking, and incentives are twisted. To solve the most pressing social and environmental problems of our time, there are no barcodes and PayPal is not accepted, so we have a tougher path than does Google or Amazon. We do this work because we care, not because it is easy. Remember:
At its best, big data can be interpreted to help us allocate our resources to maximize social impact. It can help us evolve from what “might be working” to what has “maximum likelihood to work the best.” It can help us to prevent future challenges, to predict shortages, and to avoid disasters. This insight can direct our time, resources, and services more wisely. But unlocking the power of big data is not easy and it’s not cheap. We cannot expect nonprofits to add this to their list of things to do with existing resources, so we must encourage new funding, learn from the pioneers doing this work, and continue the spirit of creativity, innovation, and optimism that is needed in this sector.
Note: Amanda Greco contributed to and edited this piece, a true partner.
I’d also like to acknowledge the Data on Purpose conference at Stanford University and presenters Nancy Lublin, Andrew Means, and Jim Fruchterman for many of the ideas summarized above.