Catching up (again!) on DemocracySpot

cover-bookIt’s been a while since the last post here. In compensation, it’s not been a bad year in terms of getting some research out there. First, we finally managed to publish “Civic Tech in the Global South: Assessing Technology for the Public Good.” With a foreword by Beth Noveck, the book is edited by Micah Sifry and myself, with contributions by Evangelia Berdou, Martin Belcher, Jonathan Fox, Matt Haikin, Claudia Lopes, Jonathan Mellon and Fredrik Sjoberg.

The book is comprised of one study and three field evaluations of civic tech initiatives in developing countries. The study reviews evidence on the use of twenty-three information and communication technology (ICT) platforms designed to amplify citizen voices to improve service delivery. Focusing on empirical studies of initiatives in the global south, the authors highlight both citizen uptake (yelp) and the degree to which public service providers respond to expressions of citizen voice (teeth). The first evaluation looks at U-Report in Uganda, a mobile platform that runs weekly large-scale polls with young Ugandans on a number of issues, ranging from access to education to early childhood development. The following evaluation takes a closer look at MajiVoice, an initiative that allows Kenyan citizens to report, through multiple channels, complaints with regard to water services. The third evaluation examines the case of Rio Grande do Sul’s participatory budgeting – the world’s largest participatory budgeting system – which allows citizens to participate either online or offline in defining the state’s yearly spending priorities. While the comparative study has a clear focus on the dimension of government responsiveness, the evaluations examine civic technology initiatives using five distinct dimensions, or lenses. The choice of these lenses is the result of an effort bringing together researchers and practitioners to develop an evaluation framework suitable to civic technology initiatives.

The book was a joint publication by The World Bank and Personal Democracy Press. You can download the book for free here.

Women create fewer online petitions than men — but they’re more successful

clinton

Another recent publication was a collaboration between Hollie R. Gilman, Jonathan Mellon, Fredrik Sjoberg and myself. By examining a dataset covering Change.org online petitions from 132 countries, we assess whether online petitions may help close the gap in participation and representation between women and men. Tony Saich, director of Harvard’s Ash Center for Democratic Innovation (publisher of the study), puts our research into context nicely:

The growing access to digital technologies has been considered by democratic scholars and practitioners as a unique opportunity to promote participatory governance. Yet, if the last two decades is the period in which connectivity has increased exponentially, it is also the moment in recent history that democratic growth has stalled and civic spaces have shrunk. While the full potential of “civic technologies” remains largely unfulfilled, understanding the extent to which they may further democratic goals is more pressing than ever. This is precisely the task undertaken in this original and methodologically innovative research. The authors examine online petitions which, albeit understudied, are one of the fastest growing types of political participation across the globe. Drawing from an impressive dataset of 3.9 million signers of online petitions from 132 countries, the authors assess the extent to which online participation replicates or changes the gaps commonly found in offline participation, not only with regards to who participates (and how), but also with regards to which petitions are more likely to be successful. The findings, at times counter-intuitive, provide several insights for democracy scholars and practitioners alike. The authors hope this research will contribute to the larger conversation on the need of citizen participation beyond electoral cycles, and the role that technology can play in addressing both new and persisting challenges to democratic inclusiveness.

But what do we find? Among other interesting things, we find that while women create fewer online petitions than men, they’re more successful at it! This article in the Washington Post summarizes some of our findings, and you can download the full study here.

Other studies that were recently published include:

The Effect of Bureaucratic Responsiveness on Citizen Participation (Public Administration Review)

Abstract:

What effect does bureaucratic responsiveness have on citizen participation? Since the 1940s, attitudinal measures of perceived efficacy have been used to explain participation. The authors develop a “calculus of participation” that incorporates objective efficacy—the extent to which an individual’s participation actually has an impact—and test the model against behavioral data from the online application Fix My Street (n = 399,364). A successful first experience using Fix My Street is associated with a 57 percent increase in the probability of an individual submitting a second report, and the experience of bureaucratic responsiveness to the first report submitted has predictive power over all future report submissions. The findings highlight the importance of responsiveness for fostering an active citizenry while demonstrating the value of incidentally collected data to examine participatory behavior at the individual level.

Does online voting change the outcome? Evidence from a multi-mode public policy referendum (Electoral Studies)

Abstract:

Do online and offline voters differ in terms of policy preferences? The growth of Internet voting in recent years has opened up new channels of participation. Whether or not political outcomes change as a consequence of new modes of voting is an open question. Here we analyze all the votes cast both offline (n = 5.7 million) and online (n = 1.3 million) and compare the actual vote choices in a public policy referendum, the world’s largest participatory budgeting process, in Rio Grande do Sul in June 2014. In addition to examining aggregate outcomes, we also conducted two surveys to better understand the demographic profiles of who chooses to vote online and offline. We find that policy preferences of online and offline voters are no different, even though our data suggest important demographic differences between offline and online voters.

We still plan to publish a few more studies this year, one looking at digitally-enabled get-out-the-vote (GOTV) efforts, and two others examining the effects of participatory governance on citizens’ willingness to pay taxes (including a fun experiment in 50 countries across all continents).

In the meantime, if you are interested in a quick summary of some of our recent research findings, this 30 minutes video of my keynote at the last TicTEC Conference in Florence should be helpful.

 

 

New Papers Published: FixMyStreet and the World’s Largest Participatory Budgeting

2016_7_5_anderson-lopes_consulta-popular_virtual

Voting in Rio Grande do Sul’s Participatory Budgeting  (picture by Anderson Lopes)

Here are two new published papers that my colleagues Jon Mellon, Fredrik Sjoberg and myself have been working on.

The first, The Effect of Bureaucratic Responsiveness on Citizen Participation, published in Public Administration Review, is – to our knowledge – the first study to quantitatively assess at the individual level the often-assumed effect of government responsiveness on citizen engagement. It also describes an example of how the data provided through digital platforms may be leveraged to better understand participatory behavior. This is the fruit of a research collaboration with MySociety, to whom we are extremely thankful.

Below is the abstract:

What effect does bureaucratic responsiveness have on citizen participation? Since the 1940s, attitudinal measures of perceived efficacy have been used to explain participation. The authors develop a “calculus of participation” that incorporates objective efficacy—the extent to which an individual’s participation actually has an impact—and test the model against behavioral data from the online application Fix My Street (n = 399,364). A successful first experience using Fix My Street is associated with a 57 percent increase in the probability of an individual submitting a second report, and the experience of bureaucratic responsiveness to the first report submitted has predictive power over all future report submissions. The findings highlight the importance of responsiveness for fostering an active citizenry while demonstrating the value of incidentally collected data to examine participatory behavior at the individual level.

An earlier, ungated version of the paper can be found here.

The second paper, Does Online Voting Change the Outcome? Evidence from a Multi-mode Public Policy Referendum, has just been published in Electoral Studies. In an earlier JITP paper (ungated here) looking at Rio Grande do Sul State’s Participatory Budgeting – the world’s largest – we show that, when compared to offline voting, online voting tends to attract participants who are younger, male, of higher income and educational attainment, and more frequent social media users. Yet, one question remained: does the inclusion of new participants in the process with a different profile change the outcomes of the process (i.e. which projects are selected)? Below is the abstract of the paper.

Do online and offline voters differ in terms of policy preferences? The growth of Internet voting in recent years has opened up new channels of participation. Whether or not political outcomes change as a consequence of new modes of voting is an open question. Here we analyze all the votes cast both offline (n = 5.7 million) and online (n = 1.3 million) and compare the actual vote choices in a public policy referendum, the world’s largest participatory budgeting process, in Rio Grande do Sul in June 2014. In addition to examining aggregate outcomes, we also conducted two surveys to better understand the demographic profiles of who chooses to vote online and offline. We find that policy preferences of online and offline voters are no different, even though our data suggest important demographic differences between offline and online voters.

The extent to which these findings are transferable to other PB processes that combine online and offline voting remains an empirical question. In the meantime, nonetheless, these findings suggest a more nuanced view of the potential effects of digital channels as a supplementary means of engagement in participatory processes. I hope to share an ungated version of the paper in the coming days.

10 Most Read Posts in 2013

Below is a selection of the 10 most read posts at DemocracySpot in 2013. Thanks to all of those who stopped by throughout the year, and happy 2014.

1. Does transparency lead to trust? Some evidence on the subject.

2. The Foundations of Motivation for Citizen Engagement

3. Open Government, Feedback Loops, and Semantic Extravaganza

4. Open Government and Democracy

5. What’s Wrong with e-Petitions and How to Fix them

6. Lawrence Lessig on Sortition and Citizen Participation

7. Unequal Participation: Open Government’s Unresolved Dilemma

8. The Effect of SMS on Participation: Evidence from Uganda

9. The Uncertain Relationship Between Open Data and Accountability

10. Lisbon Revisited: Notes on Participation

12 Papers on Social Media and Political Participation

Screen Shot 2013-05-27 at 21.47.06

I just came across the website of the Social Media and Political Participation conference, which took place in Florence this May.

Below is the presentation by Henry Farrel (from the Monkey Cage) on Cognitive Democracy and the Internet, followed by links to the papers.

Cognitive Democracy and the Internet Henry Farrell, George Washington University

Politics 2.0: The Multifaceted Effect of Broadband Internet on Political Participation Francesco Sobbrio, European University Institute

Birds of the Same Feather Tweet Together: Bayesian Ideal Point Estimation Using Twitter Data Pablo Barbera, New York University

Politicians Go Social. Estimating Intra-Party Heterogeneity (and its Effects) through the Analysis of Social Media Andrea Ceron, University of Milan

Connective Action in European Mass Protest  Eva Anduiza, Autonomous University of Barcelona

The Bridges and Brokers of Global Campaigns in the Context of Social Media Sandra Gonzalez-Bailon, Oxford Internet Institute

Every Tweet Counts? How Sentiment Analysis of Social Media Can Improve our Knowledge of Citizens’ Policy Preferences: An Application to Italy and France Stefano Iacus, University of Milan

The Rise and Decline of the “Occupy Wall Street” Movement from a Digital Perspective Alessandro Flammini, University of Indiana

Is the Internet Good or Bad for Politics? Yes. Let’s talk about How and Why Zeynep Tufekci, University of North Carolina, Chapel Hill

Follow the leader! Dynamics and Patterns of Activity among the Followers of the Main Italian Political Leaders during the 2013 General Election Campaign Cristian Vaccari, New York University and University of Bologna

Social Networks, Peer Pressure and Protest Participation Alexey Makarin, New Economic School, Moscow

Mobilizing Online Data to Understand Offline Mobilization: Two Attempts at Online Observational Research in Russia   Sam Greene, King’s College London

The Foundations of Motivation for Citizen Engagement

Screen Shot 2013-05-01 at 11.23.46

Discussions about incentives to participate are increasingly common, but they are as shallow as most conversations nowadays about the subject of “feedback loops”. And very little reflection is actually dedicated to questions such as why, when and how people participate.

This is why this talk by Judd Antin, User Experience Researcher at Facebook, is one of the best I’ve heard lately. He goes a step further than making commonsensical assumptions, and examines the issue of motivations to participate in a more critical and systematic manner. When it comes to technology mediated processes, Judd is actually one of the few people looking seriously at the issue of incentives/motivations to participate.

In the talk Judd begins by arguing that “(…) the foundations of motivation in the age of social media, they are kind of the same as the foundations of motivation before the age of social media.” I cannot help but agree and sympathize with the statement. It is particularly annoying to  hear on a daily basis claims suggesting that individual and social processes are fundamentally altered by technologies, and “how new” this field is. “I don’t fool myself into thinking that this is a brand new world”, remarks Judd. Too bad so many are fooling themselves these days.

Judd’s take on incentives to participate is particularly sobering for some cheerleaders of gamification,  highlighting the limits of instrumental rewards and the need to focus on issues such as group identification, efficacy and – importantly – simplicity.

Finally, and on a more anecdotal note, it is interesting to see how some issues are similar across different spaces. At some point Judd points out that the “dislike” button is one of the features most requested by Facebook users. In a similar vein, one of the most requested features for e-Petitions platforms is the possibility to sign “against” a petition.

In both cases, these requests have been largely ignored. My feeling is that the implications for these choices of design for collective action are far from neutral, and these are issues that we should be looking at more closely.

In any case, Judd’s talk is great, and so are his articles: you can find a list of his most recent ones below.

Title / Author Year
SYSTEM FOR CUSTOM USER-GENERATED ACHIEVEMENT BADGES BASED ON ACTIVITY FEEDS
J Antin, EF Churchill, DA Shamma, M De Sa
US Patent 20,130,086,484
2013
Social desirability bias and self-reports of motivation: a study of amazon mechanical turk in the US and India
J Antin, A Shaw
Proceedings of the 2012 ACM annual conference on Human Factors in Computing …
2012
Profanity use in online communities
S Sood, J Antin, E Churchill
Proceedings of the 2012 ACM annual conference on Human Factors in Computing …
2012
Using Crowdsourcing to Improve Profanity Detection
SO Sood, J Antin, E Churchill
AAAI Spring Symposium Series, 69-74
2012
Local experts and online review sites
J Antin, M de Sa, EF Churchill
Proceedings of the acm 2012 conference on computer supported cooperative …
2012
Some of all human knowledge: gender and participation in peer production
A Forte, J Antin, S Bardzell, L Honeywell, J Riedl, S Stierch
Proceedings of the ACM 2012 conference on Computer Supported Cooperative …
2012
Apples to Oranges?: Comparing across studies of open collaboration/peer production
J Antin, EH Chi, J Howison, S Paul, A Shaw, J Yew
Proceedings of the 7th International Symposium on Wikis and Open …
2011
Gender differences in Wikipedia editing
J Antin, R Yee, C Cheshire, O Nov
Proceedings of the 7th International Symposium on Wikis and Open …
2011
Mobile augmented reality: video prototyping
M de Sá, J Antin, D Shamma, EF Churchill
Proceedings of the 2011 annual conference extended abstracts on Human …
2011
My kind of people?: perceptions about wikipedia contributors and their motivations
J Antin
Proceedings of the 2011 annual conference on Human factors in computing …
2011
Workshop on online reputation: context, privacy, and reputation management
J Antin, EF Churchill, BC Chen
Proceedings of the 20th international conference companion on World wide web …
2011
Technology-Mediated Contributions: Editing Behaviors Among New Wikipedians
J Antin, C Cheshire, O Nov
2011
Automatic identification of personal insults on social news sites
SO Sood, EF Churchill, J Antin
Journal of the American Society for Information Science and Technology
2011
Badges in social media: A social psychological perspective
J Antin, E Churchill
Human Factors, 1-4
2011
Toy Psychology-Using gaming tactics to shape our online behavior may not be as effective as some have hoped.
J Antin
Technology Review-Massachussets Institute ofTechnology-English Edition, 11
2011
General and Familiar Trust in Websites
C Cheshire, J Antin, KS Cook, E Churchill
Knowledge, Technology & Policy, 1-21
2010
Everyday favors: A case study of a local online gift exchange system
E Suhonen, A Lampinen, C Cheshire, J Antin
Proceedings of the 16th ACM international conference on Supporting group …
2010
Behaviors, adverse events, and dispositions: An empirical study of online discretion and information control
C Cheshire, J Antin, E Churchill
Journal of the American Society for Information Science and Technology 61 (7 …
2010
NONE OF US IS AS LAZY AS ALL OF US
C Cheshire, J Antin
Information, Communication & Society 13 (4), 537-555
2010
With a little help from my friends: Self‐interested and prosocial behavior on MySpace Music
J Antin, M Earp
Journal of the American Society for Information Science and Technology 61 (5 …
2010

Isolating the Effects of Electoral Participation on Political Efficacy and Political Trust

By Victoria Shineman

There is a rich literature discussing the effects of participation, and a growing number of studies have tried to estimate proposed effects using empirical data. However, empirical testing is difficult because participation is typically both voluntary and costly, causing it to be partially determined by the characteristics it is theorized to affect. Put simply, there is an endogeneity problem. This paper discusses theories regarding how engaging in the act of participation might affect political efficacy and political trust, and then contributes to the empirical literature through experimental innovations which improve our ability to make valid causal inferences. An intensive mobilization treatment was integrated into a panel survey conducted before and after the 2011 San Francisco Municipal Election. Actual voter turnout was validated from the official voter history file. The mobilization treatment increased participation by over 33 percentage points, generating an excellent opportunity to isolate exogenously driven participation. The analysis uses assignment to the mobilization treatment as an instrument for voter turnout, in order to isolate and estimate the independent effect of being mobilized to vote on different dimensions of political efficacy and political trust. Heterogeneous treatment effects are also identified, based on whether each subject approved or disapproved of the electoral outcomes. This paper is part of a larger project intended to isolate and estimate the effects of participation. Additional experiments and observational studies will soon be integrated into the analysis.

Read the full paper here [PDF].