The Uncertain Relationship Between Open Data and Accountability

My article in response to Yu and Robinson’s recent paper on open data has just been published in the UCLA Law Review Discourse: The Uncertain Relationship Between Open Data and Accountability: A Response to Yu and Robinson’s The New Ambiguity of “Open Government”

Below is the abstract:

By looking at the nature of data that may be disclosed by governments, Harlan Yu and David Robinson provide an analytical framework that evinces the ambiguities underlying the term “open government data.” While agreeing with their core analysis, I contend that the authors ignore the enabling conditions under which transparency may lead to accountability, notably the publicity and political agency conditions. I argue that the authors also overlook the role of participatory mechanisms as an essential element in unlocking the potential for open data to produce better government decisions and policies. Finally, I conduct an empirical analysis of the publicity and political agency conditions in countries that have launched open data efforts, highlighting the challenges associated with open data as a path to accountability.

As I wrote the article, it became even more evident to me that the challenges for open data resemble those of democracy. To be successful, both depend on free press, fair elections, and multiple avenues of citizen participation. The resemblance goes one step further: both are most needed where they are least likely to thrive. On democracy and challenging environments, political scientist Robert Dahl wrote:

Democracy, it appears, is a bit chancy.  But its chances also depend on what we do ourselves.  Even if we cannot count on benign forces to favor democracy, we are not mere victims of blind forces over which we have no control. With adequate understanding of what democracy requires and the will to meet its requirements, we can act to preserve and, what is more, to advance democratic ideas and practices

May Dahl’s call resonate with the open data movement.

The Foundations of Motivation for Citizen Engagement

Screen Shot 2013-05-01 at 11.23.46

Discussions about incentives to participate are increasingly common, but they are as shallow as most conversations nowadays about the subject of “feedback loops”. And very little reflection is actually dedicated to questions such as why, when and how people participate.

This is why this talk by Judd Antin, User Experience Researcher at Facebook, is one of the best I’ve heard lately. He goes a step further than making commonsensical assumptions, and examines the issue of motivations to participate in a more critical and systematic manner. When it comes to technology mediated processes, Judd is actually one of the few people looking seriously at the issue of incentives/motivations to participate.

In the talk Judd begins by arguing that “(…) the foundations of motivation in the age of social media, they are kind of the same as the foundations of motivation before the age of social media.” I cannot help but agree and sympathize with the statement. It is particularly annoying to  hear on a daily basis claims suggesting that individual and social processes are fundamentally altered by technologies, and “how new” this field is. “I don’t fool myself into thinking that this is a brand new world”, remarks Judd. Too bad so many are fooling themselves these days.

Judd’s take on incentives to participate is particularly sobering for some cheerleaders of gamification,  highlighting the limits of instrumental rewards and the need to focus on issues such as group identification, efficacy and – importantly – simplicity.

Finally, and on a more anecdotal note, it is interesting to see how some issues are similar across different spaces. At some point Judd points out that the “dislike” button is one of the features most requested by Facebook users. In a similar vein, one of the most requested features for e-Petitions platforms is the possibility to sign “against” a petition.

In both cases, these requests have been largely ignored. My feeling is that the implications for these choices of design for collective action are far from neutral, and these are issues that we should be looking at more closely.

In any case, Judd’s talk is great, and so are his articles: you can find a list of his most recent ones below.

Title / Author Year
SYSTEM FOR CUSTOM USER-GENERATED ACHIEVEMENT BADGES BASED ON ACTIVITY FEEDS
J Antin, EF Churchill, DA Shamma, M De Sa
US Patent 20,130,086,484
2013
Social desirability bias and self-reports of motivation: a study of amazon mechanical turk in the US and India
J Antin, A Shaw
Proceedings of the 2012 ACM annual conference on Human Factors in Computing …
2012
Profanity use in online communities
S Sood, J Antin, E Churchill
Proceedings of the 2012 ACM annual conference on Human Factors in Computing …
2012
Using Crowdsourcing to Improve Profanity Detection
SO Sood, J Antin, E Churchill
AAAI Spring Symposium Series, 69-74
2012
Local experts and online review sites
J Antin, M de Sa, EF Churchill
Proceedings of the acm 2012 conference on computer supported cooperative …
2012
Some of all human knowledge: gender and participation in peer production
A Forte, J Antin, S Bardzell, L Honeywell, J Riedl, S Stierch
Proceedings of the ACM 2012 conference on Computer Supported Cooperative …
2012
Apples to Oranges?: Comparing across studies of open collaboration/peer production
J Antin, EH Chi, J Howison, S Paul, A Shaw, J Yew
Proceedings of the 7th International Symposium on Wikis and Open …
2011
Gender differences in Wikipedia editing
J Antin, R Yee, C Cheshire, O Nov
Proceedings of the 7th International Symposium on Wikis and Open …
2011
Mobile augmented reality: video prototyping
M de Sá, J Antin, D Shamma, EF Churchill
Proceedings of the 2011 annual conference extended abstracts on Human …
2011
My kind of people?: perceptions about wikipedia contributors and their motivations
J Antin
Proceedings of the 2011 annual conference on Human factors in computing …
2011
Workshop on online reputation: context, privacy, and reputation management
J Antin, EF Churchill, BC Chen
Proceedings of the 20th international conference companion on World wide web …
2011
Technology-Mediated Contributions: Editing Behaviors Among New Wikipedians
J Antin, C Cheshire, O Nov
2011
Automatic identification of personal insults on social news sites
SO Sood, EF Churchill, J Antin
Journal of the American Society for Information Science and Technology
2011
Badges in social media: A social psychological perspective
J Antin, E Churchill
Human Factors, 1-4
2011
Toy Psychology-Using gaming tactics to shape our online behavior may not be as effective as some have hoped.
J Antin
Technology Review-Massachussets Institute ofTechnology-English Edition, 11
2011
General and Familiar Trust in Websites
C Cheshire, J Antin, KS Cook, E Churchill
Knowledge, Technology & Policy, 1-21
2010
Everyday favors: A case study of a local online gift exchange system
E Suhonen, A Lampinen, C Cheshire, J Antin
Proceedings of the 16th ACM international conference on Supporting group …
2010
Behaviors, adverse events, and dispositions: An empirical study of online discretion and information control
C Cheshire, J Antin, E Churchill
Journal of the American Society for Information Science and Technology 61 (7 …
2010
NONE OF US IS AS LAZY AS ALL OF US
C Cheshire, J Antin
Information, Communication & Society 13 (4), 537-555
2010
With a little help from my friends: Self‐interested and prosocial behavior on MySpace Music
J Antin, M Earp
Journal of the American Society for Information Science and Technology 61 (5 …
2010

Are ‘Good’ Citizens ‘Good’ Participants?

Article by Catherine Bolzendahl and Hilde Coffé recently published at Political Studies (2013):

Are ‘Good’ Citizens ‘Good’ Participants? Testing Citizenship Norms and Political Participation across 25 Nations. 

Abstract:

Whereas research on political participation typically investigates a variety of socio-economic and attitudinal characteristics, this cross-national study focuses on the relevance of norms when explaining political participation. We examine respondents’ normative beliefs about the importance of various measures of ‘good citizenship’, and their relationship to three modes of political engagement (activism, party membership and voting). We find assigning higher importance to paying taxes/obeying the law is negatively linked to all forms of participation, whereas the opposite is true for norms about the importance of voting and being active in associations. Greater emphasis on norms about understanding others and shopping politically is positively associated with political activism but not with more institutional forms of participation. The relationship between norms and participation differs somewhat across nations, with the most differences between Eastern European respondents and those from Western European and Western non-European respondents. In line with theories on democratic learning, we find that the relationship between citizenship norms and participation is often weakest among Eastern Europeans. Conclusions about the subjective and variable nature of democratic citizenship are discussed.

An interesting finding is the weak link between the duty to “keep a watch on the actions of government” and most types of participation (i.e. political activism and electoral participation). I cannot help but speculate about the extent to which these findings may help to explain why generally it is relatively easier to engage citizens in participatory processes (e.g. participatory budgeting) than have them monitor the outcomes of these same processes (e.g. oversight of budget execution).

Another possible reading is that the citizen who participates is different from the citizen who monitors. One of the practical implications of this would be that we should consider segmenting audiences (and outreach efforts) according to specific stages of the policy cycle.

Read the full article here.

Isolating the Effects of Electoral Participation on Political Efficacy and Political Trust

By Victoria Shineman

There is a rich literature discussing the effects of participation, and a growing number of studies have tried to estimate proposed effects using empirical data. However, empirical testing is difficult because participation is typically both voluntary and costly, causing it to be partially determined by the characteristics it is theorized to affect. Put simply, there is an endogeneity problem. This paper discusses theories regarding how engaging in the act of participation might affect political efficacy and political trust, and then contributes to the empirical literature through experimental innovations which improve our ability to make valid causal inferences. An intensive mobilization treatment was integrated into a panel survey conducted before and after the 2011 San Francisco Municipal Election. Actual voter turnout was validated from the official voter history file. The mobilization treatment increased participation by over 33 percentage points, generating an excellent opportunity to isolate exogenously driven participation. The analysis uses assignment to the mobilization treatment as an instrument for voter turnout, in order to isolate and estimate the independent effect of being mobilized to vote on different dimensions of political efficacy and political trust. Heterogeneous treatment effects are also identified, based on whether each subject approved or disapproved of the electoral outcomes. This paper is part of a larger project intended to isolate and estimate the effects of participation. Additional experiments and observational studies will soon be integrated into the analysis.

Read the full paper here [PDF].

Eurobarometer: Citizens Engaged in Participatory Democracy

A new report by Eurobarometer on citizen engagement in participatory democracy has been recently published. Here are some of the findings:

A third (34%) of respondents say that they have signed a petition in the last two years. However, the proportion of people who have done this ranges considerably, from 53% in the UK to 7% in Cyprus. Other relatively popular forms of engagement are expressing one’s views online (28%), expressing one’s views with an elected local representative (24%), and taking part in a public debate at local or regional level (18%).

Men are more likely than women to have attempted to express their view using most of the means under discussion; they are also more likely to be members of an NGO or similar association.

A fifth of respondents (20%) are members of an organisation with a specific economic, social, environmental, cultural or sporting interest, while 17% are in another organisation with a special interest, and 16% are Trade Union members. 

The Nordic countries demonstrate a very high level of participation in NGOs and associations, especially Trade Unions. However, in 18 Member States, more than half of the respondents say that they have not had any involvement with this type of organisation. 

Respondents who have expressed their views or joined an NGO are more likely to believe that ways of influencing political decision-making, such as voting, are effective, and also that NGOs can influence political decisions.

And a bit more on socio-demographic traits and participation (highlights are mine):

According to the socio-demographic data, men are more likely than women to have used various means of expressing their views, including taking part in a public debate at local/regional level (22% vs. 15% for women), expressing their views to a local elected representative (27% vs. 20%), and expressing their views via the Internet or social media (32% vs. 25%). However, equal numbers of men and women (both 34%) say that they signed a petition. Overall, 45% of women say that they did none of these things in order to express their views, as opposed to 38% of men.

People in different age groups demonstrate preferences for using different means of expressing their views on public issues. Younger respondents are more likely to use the Internet or social media: 42% of 15-24 year-olds did this during the past two years, but this falls to 17% among people aged 55 or over. Respondents aged 40 and over (26-27%) are more likely to express their views with their local or regional elected representatives than 15-24 year-olds (16%), while people in the 25-39 age bracket (40%) are the most likely to have signed a petition (only 28% of respondents aged 55 and over did this). Respondents aged 55 or over are the most inclined to say that they did not do any of these things: 48% say this, compared with 37-39% of people in the other three age groups. 

Respondents with a higher level of education are more likely to try to express their views via all the means under discussion than people who finished their education at a younger age. For example, 42% of people who finished their education aged 20 or over have  signed a petition in the last two years, compared with just 16% of those who left school aged 15 or below. While 62% of people in the latter group did none of these things in order to express their view, only 34% of people who finished their education aged 20 or over say this. 

In terms of occupation, employees and self-employed people are more likely to seek to express their views using the various available means than manual workers or people who are not working. Nearly half of manual workers (49%) and people who are not working (47%) did not do any of these things, compared with 35% of employees and 34% of self-employed people.

The full report is available here [PDF]. 

Public participation in community and regional planning

picture by jczart on flickr.

Paper by Nicole Peterson, AICP.

Public participation in community and regional planning is both imperative and problematic. The purpose of this paper is to draw attention to the importance of public participation in planning, explain the barriers to implementation, and provide recommendations to improve public involvement in community and regional planning.

Interesting description of how participation in planning processes evolved in the US:

The American civil rights movement of the 1960s and 1970s brought citizen involvement to the forefront of  planning and politics. The combination of political scandals (e.g. assassinations, Vietnam, Watergate), environmental degradation (e.g. Cleveland’s Cuyahoga River fire in 1969) and the sweeping urban renewal of the  early 1900’s sparked citizen engagement in this period. Diane Day writes, “Significant interest [in citizen participation] began in the 1960s and 1970s as North America was in the midst of what appeared to be a countercultural revolution.” (Day, 1997, p. 421) The ‘countercultural revolution’ as Day calls it is a symbol of the unrest and distrust in government that led to citizens exercising their rights to engage in planning and democracy in America.

Read more here [PDF].

Citizen Engagement – Seven Questions, One Conversation

(cross posted from the World Bank’s Voices Blog)

Calls for increased citizen empowerment are heard from across the spectrum, ranging from governments and donors to CSOs and multilateral efforts such as the Open Government Partnership.

The World Bank Group, in partnership withCIVICUS, the Government of Finland andInterAction will host a conference on citizen engagement on March 18, 2013 to highlight the value of engaging with citizens for effective development.

The Citizen Voices conference will focus on citizen engagement and feedback systems that strengthen the quality of policy making and service delivery, where the impact on the poor is most direct. The conference aims to explore how citizen engagement is essential for effective development, move from knowledge to action, and establish concrete partnerships for scaling up at global and national levels.

But while the claims for citizen engagement abound, less discussion is dedicated to how to design and implement participatory processes that deliver their expected benefits, such as increased accountability and better delivery of policies and services. As part of this problem, not enough attention is paid to the various outcomes that participatory processes may engender and what they mean for policy and development.

For instance, in some cases participation may lead to disappointing results, such as citizens’ mistrust of government, elite capture and public opinion polarization. Conversely, participation can also be associated with surprisingly positive outcomes, such as increased levels of tax compliance and reduced infant mortality. But how can we explain these disparities in results?

Shedding light on the question of when, why and how participation works is precisely the objective of this conversation. Thus, to kick off the debate, I would like to start by considering seven questions:

  • How can we measure the success of citizen engagement initiatives?
  • How essential are processes of organizational and institutional change?
  • Can political will towards increased participation be stimulated?
  • What role does organized civil society play in citizen engagement processes?
  • How can we foster inclusiveness and what are the impacts of different methods of participant selection (e.g. open, randomized)?
  • Can we learn anything from the private sector about listening to external audiences?
  • What is the actual role of technology (if any) in participatory processes?

Parallel to the event, and running until the end of this month, the World Bank has launched an online conversation on citizen engagement to help tackling these and other issues. Needless to say, the questions are far from exhaustive. Maybe some are even secondary. But I believe that considering them might bring us closer to answering an even more fundamental question: that is, how can we leverage the dispersed knowledge of citizens to shape decisions that affect their lives?

Join the conversation on Striking Poverty and follow the conference live on World Bank Live.

Transforming Local Civic Engagement Through an Online Game

(talk starts at 6:10)

The problem of civic engagement is often un­derstood as a lack of participation. People do not show up to meetings, they do not engage in their civic institutions or communicate with decision-makers.

The Engagement Game Lab has developed an online game called Community PlanIt—which has been played in six distinct planning processes ranging from urban planning in Detroit and Philadelphia to education planning in Boston—to explore how game mechanics and social interaction can move local civic processes beyond transactive participation towards a sustained, reflective mode of civic interaction.

In this talk, Eric Gordon—researcher, game designer, and Berkman Fellow—explores the unique affordances of Community PlanIt for building social trust, engaging youth in civic life, and developing shared local narratives.

More info about the event here.

Unequal Participation: Open Government’s Unresolved Dilemma

( cross-posted from techPresident)

In my frequent conversations about open government and citizen participation, the subject of elite capture (or “how representative it is”) is almost unavoidable. Some go as far as evaluating participatory initiatives on the grounds of an ideal notion of representativeness: participants should perfectly mirror the socio-demographic traits of the larger population from which they come.

But oddly enough, the same people who raise these concerns about participatory initiatives are much less inclined to apply the same reasoning and standards to traditional politics. In other words, few take the time to consider how representative and inclusive existing electoral democracy actually is. An article by Nicholas Carnes at the New York Times about political representation in the United States puts the issue into perspective:

If millionaires were a political party, that party would make up roughly 3 percent of American families, but it would have a super-majority in the Senate, a majority in the House, a majority on the Supreme Court and a man in the White House. If working-class Americans were a political party, that party would have made up more than half the country since the start of the 20th century. But legislators from that party (those who last worked in blue-collar jobs before entering politics) would never have held more than 2 percent of the seats in Congress.

I’ve yet to see a participatory process that produces similar results. But the limits of representation do not stop there. African Americans and Latinos are still greatly under-represented in US politics. The gender issue is no different: with the House of Representatives only 17 percent women, the Inter Parliamentary Union ranks the US 82nd in female representation in politics, behind countries such as the Arab Emirates, Sudan, Mauritania and Kazakhstan.

Obviously, the US is by no means exceptional in exclusion. Those working in the field of political participation have long been aware of the excluding effect of representative systems. As put by political scientist Arend Lijphart, unequal participation remains as representative democracy’s “unresolved dilemma.” Even more unfortunately, underlines Lijphart, inequalities in representation and influence “are not randomly distributed, but systematically biased in favor of more privileged citizens (…) and against less advantaged citizens”.

And it is from this unresolved dilemma that the raison d’être of participatory innovations stems. But rather than a replacement for representative systems (as misunderstood by some), participatory innovations are complementary mechanisms to enable the participation of individuals who are systematically excluded from traditional politics, ultimately increasing the overall diversity of voices that influence government.

This observation leads to a fundamental issue when assessing citizen participation initiatives: beyond questioning demographic representativeness, one must also consider the extent to which initiatives succeed (or not) in promoting the participation of previously marginalized sectors of society (i.e. inclusiveness).

So how inclusive are these mechanisms?

To continue with the US example, let’s consider one of the most exciting open government events taking place at the local level in the US: the recent adoption of participatory budgeting in NYC. Unlike most overhyped #opengov experiences, a team of researchers carried out an evaluation of the experience looking at, among other things, the extent to which it promoted inclusiveness. Below are some excerpts from the report [PDF]:

  • Twenty percent of PB voters identified themselves as African American; 14 percent as Hispanic or Latino/a; 2 percent as Asian and 2 percent as “Other.”
  • A higher percentage of African Americans participated in neighborhood assemblies (38 percent), compared to the full population in the four districts (31 percent).
  • Twenty-one percent of budget delegates and 19 percent of PB voters were born outside of the United States.
  • Participants that identified themselves as Black/African American were the most likely to volunteer to be budget delegates.
  • Women represented 64 percent of neighborhood assembly participants, 65 percent of budget delegates and 62 percent of voters in the PB process.

But how these numbers compare with participation in traditional politics is probably one of the highlights of the evaluation (emphasis is mine):

One of the most striking findings about who participated in PB [participatory budgeting] is how the data compares to other types of civic engagement, particularly voting patterns in NYC elections. Across the districts, PB engaged communities that have traditionally been uninspired by politics. People of color, low-income people and some immigrant groups turned out at higher rates than in previous elections.

A few numbers worth noting:

Latino/as represented 39 percent of voters in the 2009 City Council elections. However, 50 percent of PB voters identified themselves as Latino/a (District 8 NYC).

Black or African Americans represented 79 percent of voters in 2009 City Council elections. However, 87 percent of the district’s PB voters identified themselves as Black or African American (District 45 NYC).

Twenty-two percent of PB voters had a household income of less than $10,000 compared to 4 percent of the district’s voters in the 2009 City Council election (District 8 NYC).

I have very little doubt, if any, that the contrast would be even starker if we compared the income of those who sit on the City Council and those who participated in the NYC participatory budgeting. In City Councils across the US, less than 10 percent of members come from a blue-collar background. Conversely, the numbers on income of participatory budgeting participants speak for themselves.

As citizen engagement gains traction in the open government agenda, inclusiveness should be one of the top priorities: both from normative and empirical standpoints, more inclusive initiatives are likely to produce better outcomes. The NYC experience provides valuable lessons for donors, policymakers, advocates, and enthusiasts alike. They can find more about it here and here.

Lawrence Lessig on Sortition and Citizen Participation

 

When designing citizen engagement mechanisms I always consider sortition (or randomization) as a mechanism of participant selection. Nevertheless, and particularly in the #opengov space, my experience is that this idea does not resonate a lot: it sounds less sexy than crowdsourcing and more complicated than over-simplistic mechanisms of “civil society engagement”.

This is why it is always great to see someone like Lawrence Lessig putting forward a system of  “Citizen Conventions” for proposing amendments to the Constitution based upon sortition. In this video below, at a hearing at the U.S. Senate’s Commission of Justice, Lessig explains in a few seconds how such a system would work:

With his unique eloquence, Lessig also makes the best case for ordinary citizens to engage with the Constitution and reforms:

I think to the surprise of many people, you would see that ordinary people deliberating about what the Constitution needs and how the reforms should go forward, would far surpass ninety eight percent of what is commonly discussed in this particular context. And that’s because, frankly, politics is the one sport where the amateur is better for the nation than the professional.

Lessig’s remark on the amateur’s role in politics reminds me of something I read a while ago from the apologue of Protagoras. When charged with taking to humans the art of politics, Mercury asks Jupiter whether it should be distributed like the other arts, to the competent ones only. Jupiter replies that the art of politics should be distributed to all. Otherwise, says Jupiter, the city would not exist.