New Papers Published: FixMyStreet and the World’s Largest Participatory Budgeting


Voting in Rio Grande do Sul’s Participatory Budgeting  (picture by Anderson Lopes)

Here are two new published papers that my colleagues Jon Mellon, Fredrik Sjoberg and myself have been working on.

The first, The Effect of Bureaucratic Responsiveness on Citizen Participation, published in Public Administration Review, is – to our knowledge – the first study to quantitatively assess at the individual level the often-assumed effect of government responsiveness on citizen engagement. It also describes an example of how the data provided through digital platforms may be leveraged to better understand participatory behavior. This is the fruit of a research collaboration with MySociety, to whom we are extremely thankful.

Below is the abstract:

What effect does bureaucratic responsiveness have on citizen participation? Since the 1940s, attitudinal measures of perceived efficacy have been used to explain participation. The authors develop a “calculus of participation” that incorporates objective efficacy—the extent to which an individual’s participation actually has an impact—and test the model against behavioral data from the online application Fix My Street (n = 399,364). A successful first experience using Fix My Street is associated with a 57 percent increase in the probability of an individual submitting a second report, and the experience of bureaucratic responsiveness to the first report submitted has predictive power over all future report submissions. The findings highlight the importance of responsiveness for fostering an active citizenry while demonstrating the value of incidentally collected data to examine participatory behavior at the individual level.

An earlier, ungated version of the paper can be found here.

The second paper, Does Online Voting Change the Outcome? Evidence from a Multi-mode Public Policy Referendum, has just been published in Electoral Studies. In an earlier JITP paper (ungated here) looking at Rio Grande do Sul State’s Participatory Budgeting – the world’s largest – we show that, when compared to offline voting, online voting tends to attract participants who are younger, male, of higher income and educational attainment, and more frequent social media users. Yet, one question remained: does the inclusion of new participants in the process with a different profile change the outcomes of the process (i.e. which projects are selected)? Below is the abstract of the paper.

Do online and offline voters differ in terms of policy preferences? The growth of Internet voting in recent years has opened up new channels of participation. Whether or not political outcomes change as a consequence of new modes of voting is an open question. Here we analyze all the votes cast both offline (n = 5.7 million) and online (n = 1.3 million) and compare the actual vote choices in a public policy referendum, the world’s largest participatory budgeting process, in Rio Grande do Sul in June 2014. In addition to examining aggregate outcomes, we also conducted two surveys to better understand the demographic profiles of who chooses to vote online and offline. We find that policy preferences of online and offline voters are no different, even though our data suggest important demographic differences between offline and online voters.

The extent to which these findings are transferable to other PB processes that combine online and offline voting remains an empirical question. In the meantime, nonetheless, these findings suggest a more nuanced view of the potential effects of digital channels as a supplementary means of engagement in participatory processes. I hope to share an ungated version of the paper in the coming days.

10 Most Read Posts in 2013

Below is a selection of the 10 most read posts at DemocracySpot in 2013. Thanks to all of those who stopped by throughout the year, and happy 2014.

1. Does transparency lead to trust? Some evidence on the subject.

2. The Foundations of Motivation for Citizen Engagement

3. Open Government, Feedback Loops, and Semantic Extravaganza

4. Open Government and Democracy

5. What’s Wrong with e-Petitions and How to Fix them

6. Lawrence Lessig on Sortition and Citizen Participation

7. Unequal Participation: Open Government’s Unresolved Dilemma

8. The Effect of SMS on Participation: Evidence from Uganda

9. The Uncertain Relationship Between Open Data and Accountability

10. Lisbon Revisited: Notes on Participation

12 Papers on Social Media and Political Participation

Screen Shot 2013-05-27 at 21.47.06

I just came across the website of the Social Media and Political Participation conference, which took place in Florence this May.

Below is the presentation by Henry Farrel (from the Monkey Cage) on Cognitive Democracy and the Internet, followed by links to the papers.

Cognitive Democracy and the Internet Henry Farrell, George Washington University

Politics 2.0: The Multifaceted Effect of Broadband Internet on Political Participation Francesco Sobbrio, European University Institute

Birds of the Same Feather Tweet Together: Bayesian Ideal Point Estimation Using Twitter Data Pablo Barbera, New York University

Politicians Go Social. Estimating Intra-Party Heterogeneity (and its Effects) through the Analysis of Social Media Andrea Ceron, University of Milan

Connective Action in European Mass Protest  Eva Anduiza, Autonomous University of Barcelona

The Bridges and Brokers of Global Campaigns in the Context of Social Media Sandra Gonzalez-Bailon, Oxford Internet Institute

Every Tweet Counts? How Sentiment Analysis of Social Media Can Improve our Knowledge of Citizens’ Policy Preferences: An Application to Italy and France Stefano Iacus, University of Milan

The Rise and Decline of the “Occupy Wall Street” Movement from a Digital Perspective Alessandro Flammini, University of Indiana

Is the Internet Good or Bad for Politics? Yes. Let’s talk about How and Why Zeynep Tufekci, University of North Carolina, Chapel Hill

Follow the leader! Dynamics and Patterns of Activity among the Followers of the Main Italian Political Leaders during the 2013 General Election Campaign Cristian Vaccari, New York University and University of Bologna

Social Networks, Peer Pressure and Protest Participation Alexey Makarin, New Economic School, Moscow

Mobilizing Online Data to Understand Offline Mobilization: Two Attempts at Online Observational Research in Russia   Sam Greene, King’s College London

The Foundations of Motivation for Citizen Engagement

Screen Shot 2013-05-01 at 11.23.46

Discussions about incentives to participate are increasingly common, but they are as shallow as most conversations nowadays about the subject of “feedback loops”. And very little reflection is actually dedicated to questions such as why, when and how people participate.

This is why this talk by Judd Antin, User Experience Researcher at Facebook, is one of the best I’ve heard lately. He goes a step further than making commonsensical assumptions, and examines the issue of motivations to participate in a more critical and systematic manner. When it comes to technology mediated processes, Judd is actually one of the few people looking seriously at the issue of incentives/motivations to participate.

In the talk Judd begins by arguing that “(…) the foundations of motivation in the age of social media, they are kind of the same as the foundations of motivation before the age of social media.” I cannot help but agree and sympathize with the statement. It is particularly annoying to  hear on a daily basis claims suggesting that individual and social processes are fundamentally altered by technologies, and “how new” this field is. “I don’t fool myself into thinking that this is a brand new world”, remarks Judd. Too bad so many are fooling themselves these days.

Judd’s take on incentives to participate is particularly sobering for some cheerleaders of gamification,  highlighting the limits of instrumental rewards and the need to focus on issues such as group identification, efficacy and – importantly – simplicity.

Finally, and on a more anecdotal note, it is interesting to see how some issues are similar across different spaces. At some point Judd points out that the “dislike” button is one of the features most requested by Facebook users. In a similar vein, one of the most requested features for e-Petitions platforms is the possibility to sign “against” a petition.

In both cases, these requests have been largely ignored. My feeling is that the implications for these choices of design for collective action are far from neutral, and these are issues that we should be looking at more closely.

In any case, Judd’s talk is great, and so are his articles: you can find a list of his most recent ones below.

Title / Author Year
J Antin, EF Churchill, DA Shamma, M De Sa
US Patent 20,130,086,484
Social desirability bias and self-reports of motivation: a study of amazon mechanical turk in the US and India
J Antin, A Shaw
Proceedings of the 2012 ACM annual conference on Human Factors in Computing …
Profanity use in online communities
S Sood, J Antin, E Churchill
Proceedings of the 2012 ACM annual conference on Human Factors in Computing …
Using Crowdsourcing to Improve Profanity Detection
SO Sood, J Antin, E Churchill
AAAI Spring Symposium Series, 69-74
Local experts and online review sites
J Antin, M de Sa, EF Churchill
Proceedings of the acm 2012 conference on computer supported cooperative …
Some of all human knowledge: gender and participation in peer production
A Forte, J Antin, S Bardzell, L Honeywell, J Riedl, S Stierch
Proceedings of the ACM 2012 conference on Computer Supported Cooperative …
Apples to Oranges?: Comparing across studies of open collaboration/peer production
J Antin, EH Chi, J Howison, S Paul, A Shaw, J Yew
Proceedings of the 7th International Symposium on Wikis and Open …
Gender differences in Wikipedia editing
J Antin, R Yee, C Cheshire, O Nov
Proceedings of the 7th International Symposium on Wikis and Open …
Mobile augmented reality: video prototyping
M de Sá, J Antin, D Shamma, EF Churchill
Proceedings of the 2011 annual conference extended abstracts on Human …
My kind of people?: perceptions about wikipedia contributors and their motivations
J Antin
Proceedings of the 2011 annual conference on Human factors in computing …
Workshop on online reputation: context, privacy, and reputation management
J Antin, EF Churchill, BC Chen
Proceedings of the 20th international conference companion on World wide web …
Technology-Mediated Contributions: Editing Behaviors Among New Wikipedians
J Antin, C Cheshire, O Nov
Automatic identification of personal insults on social news sites
SO Sood, EF Churchill, J Antin
Journal of the American Society for Information Science and Technology
Badges in social media: A social psychological perspective
J Antin, E Churchill
Human Factors, 1-4
Toy Psychology-Using gaming tactics to shape our online behavior may not be as effective as some have hoped.
J Antin
Technology Review-Massachussets Institute ofTechnology-English Edition, 11
General and Familiar Trust in Websites
C Cheshire, J Antin, KS Cook, E Churchill
Knowledge, Technology & Policy, 1-21
Everyday favors: A case study of a local online gift exchange system
E Suhonen, A Lampinen, C Cheshire, J Antin
Proceedings of the 16th ACM international conference on Supporting group …
Behaviors, adverse events, and dispositions: An empirical study of online discretion and information control
C Cheshire, J Antin, E Churchill
Journal of the American Society for Information Science and Technology 61 (7 …
C Cheshire, J Antin
Information, Communication & Society 13 (4), 537-555
With a little help from my friends: Self‐interested and prosocial behavior on MySpace Music
J Antin, M Earp
Journal of the American Society for Information Science and Technology 61 (5 …

Isolating the Effects of Electoral Participation on Political Efficacy and Political Trust

By Victoria Shineman

There is a rich literature discussing the effects of participation, and a growing number of studies have tried to estimate proposed effects using empirical data. However, empirical testing is difficult because participation is typically both voluntary and costly, causing it to be partially determined by the characteristics it is theorized to affect. Put simply, there is an endogeneity problem. This paper discusses theories regarding how engaging in the act of participation might affect political efficacy and political trust, and then contributes to the empirical literature through experimental innovations which improve our ability to make valid causal inferences. An intensive mobilization treatment was integrated into a panel survey conducted before and after the 2011 San Francisco Municipal Election. Actual voter turnout was validated from the official voter history file. The mobilization treatment increased participation by over 33 percentage points, generating an excellent opportunity to isolate exogenously driven participation. The analysis uses assignment to the mobilization treatment as an instrument for voter turnout, in order to isolate and estimate the independent effect of being mobilized to vote on different dimensions of political efficacy and political trust. Heterogeneous treatment effects are also identified, based on whether each subject approved or disapproved of the electoral outcomes. This paper is part of a larger project intended to isolate and estimate the effects of participation. Additional experiments and observational studies will soon be integrated into the analysis.

Read the full paper here [PDF].