Techniques for mobilizing citizens to vote in elections have become highly sophisticated in large part thanks to get-out-the-vote (GOTV) research, with fascinating experimental evidence from interventions to increase turnout. Until recently, the use of these techniques has been mostly limited to electoral processes, often resorting to resource intensive tactics such as door-to-door canvassing and telemarketing campaigns. But as digital technologies such as email and SMS lower the costs for targeting and contacting individuals, the adaptation of these practices to participatory processes is becoming increasingly common. This leads to the question: how effective are GOTV-type efforts when using technology outside of the electoral realm?
One of the first (if not the first) efforts to bring together technology and GOTV techniques to non-electoral processes took place in the participatory budgeting (PB) process of the municipality of Ipatinga in Brazil in 2005. An automated system of targeted phone calls to landlines was deployed, with a recorded voice message from the mayor informing residents of the time and the location of the next PB meeting closest to them. Fast forward over a decade later, and New Yorkers can receive personalized text messages on their phones indicating the nearest PB polling location. Rather than a mere coincidence, the New York case illustrates a growing trend in participatory initiatives that – consciously or not – combine technology with traditional GOTV techniques to mobilize participation.
However, and unlike GOTV in elections, little is known about the effects of these efforts in participatory processes, the reasons for which I briefly speculated about in a previous post. We have just published a study in the British Journal of Political Science that, we hope, starts to reduce this gap between practice and knowledge. Entitled “A Get-Out-the-Vote Experiment on the World’s Largest Participatory Budgeting Vote in Brazil”, the study is co-authored by Jonathan Mellon, Fredrik M. Sjoberg and myself. The experiment was conducted in close collaboration with Rio Grande do Sul’s State Government (Brazil), which holds the world’s largest participatory budgeting process.
In the experiment, over 43,000 citizens were randomly assigned to receive email and text messages encouraging them to take part in the PB voting process. We used voting records to assess the impact of these messages on turnout and support for public investments. The turnout effect we document in the study is substantially larger than what has been found in most previous GOTV studies, and particularly those focusing on the effect of technologies like email and SMS. The increase in participation, however, did not alter which projects were selected through the PB vote: voters in the control and treatment groups shared the same preferences. In the study, we also assessed whether different message framing (e.g. intrinsic versus extrinsic) mattered. Not that much, we found, and a lottery incentive treatment had the opposite effect to what many might expect. Overall, our experiment suggests that tech-enabled GOTV approaches in participatory processes are rather promising if increasing levels of participation is one of the goals. But the “more research is needed” disclaimer, as usual, applies.
You can find the final study (gated version) here, and the pre-published (open) version here.
It’s been a while since the last post here. In compensation, it’s not been a bad year in terms of getting some research out there. First, we finally managed to publish “Civic Tech in the Global South: Assessing Technology for the Public Good.” With a foreword by Beth Noveck, the book is edited by Micah Sifry and myself, with contributions by Evangelia Berdou, Martin Belcher, Jonathan Fox, Matt Haikin, Claudia Lopes, Jonathan Mellon and Fredrik Sjoberg.
The book is comprised of one study and three field evaluations of civic tech initiatives in developing countries. The study reviews evidence on the use of twenty-three information and communication technology (ICT) platforms designed to amplify citizen voices to improve service delivery. Focusing on empirical studies of initiatives in the global south, the authors highlight both citizen uptake (yelp) and the degree to which public service providers respond to expressions of citizen voice (teeth). The first evaluation looks at U-Report in Uganda, a mobile platform that runs weekly large-scale polls with young Ugandans on a number of issues, ranging from access to education to early childhood development. The following evaluation takes a closer look at MajiVoice, an initiative that allows Kenyan citizens to report, through multiple channels, complaints with regard to water services. The third evaluation examines the case of Rio Grande do Sul’s participatory budgeting – the world’s largest participatory budgeting system – which allows citizens to participate either online or offline in defining the state’s yearly spending priorities. While the comparative study has a clear focus on the dimension of government responsiveness, the evaluations examine civic technology initiatives using five distinct dimensions, or lenses. The choice of these lenses is the result of an effort bringing together researchers and practitioners to develop an evaluation framework suitable to civic technology initiatives.
The book was a joint publication by The World Bank and Personal Democracy Press. You can download the book for free here.
Women create fewer online petitions than men — but they’re more successful
Another recent publication was a collaboration between Hollie R. Gilman, Jonathan Mellon, Fredrik Sjoberg and myself. By examining a dataset covering Change.org online petitions from 132 countries, we assess whether online petitions may help close the gap in participation and representation between women and men. Tony Saich, director of Harvard’s Ash Center for Democratic Innovation (publisher of the study), puts our research into context nicely:
The growing access to digital technologies has been considered by democratic scholars and practitioners as a unique opportunity to promote participatory governance. Yet, if the last two decades is the period in which connectivity has increased exponentially, it is also the moment in recent history that democratic growth has stalled and civic spaces have shrunk. While the full potential of “civic technologies” remains largely unfulfilled, understanding the extent to which they may further democratic goals is more pressing than ever. This is precisely the task undertaken in this original and methodologically innovative research. The authors examine online petitions which, albeit understudied, are one of the fastest growing types of political participation across the globe. Drawing from an impressive dataset of 3.9 million signers of online petitions from 132 countries, the authors assess the extent to which online participation replicates or changes the gaps commonly found in offline participation, not only with regards to who participates (and how), but also with regards to which petitions are more likely to be successful. The findings, at times counter-intuitive, provide several insights for democracy scholars and practitioners alike. The authors hope this research will contribute to the larger conversation on the need of citizen participation beyond electoral cycles, and the role that technology can play in addressing both new and persisting challenges to democratic inclusiveness.
But what do we find? Among other interesting things, we find that while women create fewer online petitions than men, they’re more successful at it! This article in the Washington Post summarizes some of our findings, and you can download the full study here.
Other studies that were recently published include:
What effect does bureaucratic responsiveness have on citizen participation? Since the 1940s, attitudinal measures of perceived efficacy have been used to explain participation. The authors develop a “calculus of participation” that incorporates objective efficacy—the extent to which an individual’s participation actually has an impact—and test the model against behavioral data from the online application Fix My Street (n = 399,364). A successful first experience using Fix My Street is associated with a 57 percent increase in the probability of an individual submitting a second report, and the experience of bureaucratic responsiveness to the first report submitted has predictive power over all future report submissions. The findings highlight the importance of responsiveness for fostering an active citizenry while demonstrating the value of incidentally collected data to examine participatory behavior at the individual level.
Do online and offline voters differ in terms of policy preferences? The growth of Internet voting in recent years has opened up new channels of participation. Whether or not political outcomes change as a consequence of new modes of voting is an open question. Here we analyze all the votes cast both offline (n = 5.7 million) and online (n = 1.3 million) and compare the actual vote choices in a public policy referendum, the world’s largest participatory budgeting process, in Rio Grande do Sul in June 2014. In addition to examining aggregate outcomes, we also conducted two surveys to better understand the demographic profiles of who chooses to vote online and offline. We find that policy preferences of online and offline voters are no different, even though our data suggest important demographic differences between offline and online voters.
We still plan to publish a few more studies this year, one looking at digitally-enabled get-out-the-vote (GOTV) efforts, and two others examining the effects of participatory governance on citizens’ willingness to pay taxes (including a fun experiment in 50 countries across all continents).
In the meantime, if you are interested in a quick summary of some of our recent research findings, this 30 minutes video of my keynote at the last TicTEC Conference in Florence should be helpful.
This blog has been slow lately, but as I mentioned before, it is for a good cause. With some great colleagues I’ve been working on a series of papers (and a book) on civic technology. The first three of these papers are out. There is much more to come, but in the meantime, you can find below the abstracts and link to each of the papers. I also add the link to a presentation which highlights some other issues that we are looking at.
Effects of the Internet on Participation: Study of a Public Policy Referendum in Brazil.
Does online voting mobilize citizens who otherwise would not participate? During the annual participatory budgeting vote in the southern state of Rio Grande do Sul in Brazil – the world’s largest – Internet voters were asked whether they would have participated had there not been an online voting option (i-voting). The study documents an 8.2 percent increase in total turnout with the introduction of i-voting. In support of the mobilization hypothesis, unique survey data show that i-voting is mainly used by new participants rather than just for convenience by those who were already mobilized. The study also finds that age, gender, income, education, and social media usage are significant predictors of being online-only voters. Technology appears more likely to engage people who are younger, male, of higher income and educational attainment, and more frequent social media users.
The Effect of Government Responsiveness on Future Political Participation.
What effect does government responsiveness have on political participation? Since the 1940s political scientists have used attitudinal measures of perceived efficacy to explain participation. More recent work has focused on underlying genetic factors that condition citizen engagement. We develop a ‘Calculus of Participation’ that incorporates objective efficacy – the extent to which an individual’s participation actually has an impact – and test the model against behavioral data from FixMyStreet.com (n=399,364). We find that a successful first experience using FixMyStreet.com (e.g. reporting a pothole and having it fixed) is associated with a 54 percent increase in the probability of an individual submitting a second report. We also show that the experience of government responsiveness to the first report submitted has predictive power over all future report submissions. The findings highlight the importance of government responsiveness for fostering an active citizenry, while demonstrating the value of incidentally collected data to examine participatory behavior at the individual level.
In this project, we analyzed whether mobile phone-based surveys are a feasible and cost-effective approach for gathering statistically representative information in four low-income countries (Afghanistan, Ethiopia, Mozambique, and Zimbabwe). Specifically, we focused on three primary research questions. First, can the mobile phone survey platform reach a nationally representative sample? Second, to what extent does linguistic fractionalization affect the ability to produce a representative sample? Third, how effectively does monetary compensation impact survey completion patterns? We find that samples from countries with higher mobile penetration rates more closely resembled the actual population. After weighting on demographic variables, sample imprecision was a challenge in the two lower feasibility countries (Ethiopia and Mozambique) with a sampling error of /- 5 to 7 percent, while Zimbabwe’s estimates were more precise (sampling error of /- 2.8 percent). Surveys performed reasonably well in reaching poor demographics, especially in Afghanistan and Zimbabwe. Rural women were consistently under-represented in the country samples, especially in Afghanistan and Ethiopia. Countries’ linguistic fractionalization may influence the ability to obtain nationally representative samples, although a material effect was difficult to discern through penetration rates and market composition. Although the experimentation design of the incentive compensation plan was compromised in Ethiopia and Zimbabwe, it seems that offering compensation for survey completion mitigated attrition rates in several of the pilot countries while not reducing overall costs. These effects varied across countries and cultural settings.
I’ve been wanting to post about this paper for a while. At the intersection of technology and citizen participation this is probably one of the best studies produced in 2013 and I’m surprised I haven’t heard a lot about it outside the scholarly circle.
One of the fundamental questions concerning the use of technology to foster participation is whether it impacts inclusiveness and, if it does, in what way. That is, if technology has an effect on participation, does it reinforce or minimize participation biases? There is no straightforward answer, and the limited existing evidence suggests that the impact of technology on inclusiveness depends on a number of factors such as technology fit, institutional design and communication efforts.
We use a field experiment to study how the availability and cost of political communication channels affect the efforts constituents take to influence their representatives. We presented sampled constituents in Uganda with an opportunity to send a text-message to their representatives at one of three randomly assigned prices. This allows us to ascertain whether ICTs can “flatten” interest articulation and how access costs determine who communicates and what gets communicated to politicians. Critically, contrary to concerns that technological innovations benefit the privileged, we find that ICT leads to significant flattening: a greater share of marginalized populations use this channel compared to existing political communication channels. Price matters too, as free messaging increase uptake by about 50%. Surprisingly, subsidy-induced increases in uptake do not yield further flattening since free channels are used at higher rates by both marginalized and well-connected constituents. More subtle strategic hypotheses find little support in the data.
But even if the question of “who participates” is answered in this paper, one is left wondering “as to what effect?”. Fortunately, the authors mention in a footnote that they are collecting data for a companion paper in which they focus on the behavior of MPs, which will hopefully address this issue. Looking forward to reading that one as well.
Regarding the above picture of DRC government troops with their mobile phones, Alexis Madrigal from the Atlatinc wrote in his column last year:
I don’t know what to say about this photograph aside from suggesting that an enterprising PhD student write a dissertation on “Cell Phones in War.” How are fighting, killing, and controlling territory different when you can call your brother after battle, post a photo of your squadron on the march to Facebook, or play Angry Birds between skirmishes?
In a nutshell, the authors’ findings suggest that cell phone coverage in Africa increases the likelihood of political violence. The abstract is below:
The spread of cell phone technology across Africa has transforming effects on the economic and political sphere of the continent. In this paper, we investigate the impact of cell phone technology on violent collective action. We contend that the availability of cell phones as a communication technology allows political groups to overcome collective action problems more easily and improve in-group cooperation, and coordination. Utilizing novel, spatially disaggregated data on cell phone coverage and the location of organized violent events in Africa, we are able to show that the availability of cell phone coverage signiﬁcantly and substantially increases the probability of violent conﬂict. Our ﬁndings hold across numerous different model speciﬁcations and robustness checks, including cross-sectional models, instrumental variable techniques, and panel data methods.
It will be interesting to see how this paper resonates with different audiences, such as the ICT4D community and political scientists. Some have already started to question the methodology and underlying assumptions in the paper.
But despite the findings of this study, like it or not, at some point technology cheerleaders will have to come to terms with a simple fact: if technology helps us overcome problems of collective action, there’s no reason to believe that this can only happen when it comes to virtuous collective action. And it shouldn’t take a PhD to know that.
I just came across some interesting analysis in a study about SMS usage among low-income populations in Asia, by Juhee Kang (Michigan State University) and Moutusy Maity (Indian Institute of Management Lucknow). The study uses data collected through a survey conducted in 2011 with 9,066 low-income mobile phone users (bottom of the pyramid) from Bangladesh, Pakistan, India, Sri Lanka and Thailand.
Picture by juicyrai on flickr.
Some of the numbers provided should serve as a reminder that having a mobile phone does not necessarily mean that a person uses SMS. In other words, if you think your project is inclusive “because it uses SMS” and “nearly everybody has a mobile phone”, think twice: there’s a chance your project is not as inclusive as you’d like to think.
A few excerpts from “Texting among the Bottom of the Pyramid: Facilitators and Barriers to SMS Use among the Low-income Mobile Users in Asia”:
Of the total 9,066 respondents, 54.3 percent own a personal mobile phone (N=4926).
Approximately thirty two percent (32.2%) of the mobile owners have ever used SMS.
While the distribution of the users is similar between urban and rural, it was found that a large proportion
of the non-users live in rural areas (73%).
The reported daily income was higher among the users (USD2.88, SD=2.80) than among the non-users (USD 1.51, SD=2.58).
The non-users tend to have lower education as 83 percent of the non-users had only primary schooling or no formal education.
The users also have a higher level of access to other media such as TV, radio and personal computers than the non-users.
And some sobering conclusions that development practitioners should bear in mind:
We argue that the quantity of mobile phones in the Global South does not automatically translate into the high quality impact of mobile communication. In fact, the path between mobile access and developmental impact seems to consist of multiple stages of mobile service adoption and utilisation. While many development practitioners currently make positive assessments about the growing penetration of mobile phones in developing countries, it is still uncertain how these mobile phones can bring positive benefits to the poor, and what types of services can lead to socioeconomic development.
Making a mere provision of information via SMS may not reach the mobile owners who use mobile phones mainly for voice calls, in particular the poorest and the least educated of the poor. The study found that the barriers to SMS adoption are beyond the issues of affordability and literacy and the problem lies in the current limitations on usability and the lack of familiarity with text-based communications.