Petition Growth and Success Rates on the UK No. 10 Downing Street Website

 

Screen Shot 2013-05-16 at 08.00.47

This is the kind of research that should be informing the design of ICT mediated initiatives. It also a good example as to why policymakers  and practitioners should reach out more to scholars (and vice-versa).

Now that so much of collective action takes place online, web-generated data can further understanding of the mechanics of Internet-based mobilisation. This trace data offers social science researchers the potential for new forms of analysis, using real-time transactional data based on entire populations, rather than sample-based surveys of what people think they did or might do. This paper uses a ‘big data’ approach to track the growth of over 8,000 petitions to the UK Government on the No. 10 Downing Street website for two years, analysing the rate of growth per day and testing the hypothesis that the distribution of daily change will be leptokurtic (rather than normal) as previous research on agenda setting would suggest. This hypothesis is confirmed, suggesting that Internet-based mobilisation is characterized by tipping points (or punctuated equilibria) and explaining some of the volatility in online collective action. We find also that most successful petitions grow quickly and that the number of signatures a petition receives on its first day is a significant factor in explaining the overall number of signatures a petition receives during its lifetime. These findings have implications for the strategies of those initiating petitions and the design of web sites with the aim of maximising citizen engagement with policy issues.

Read more here [PDF].

 

New Book on Open Parliaments

Brazilian House of Representatives

Cristiano Faria’s book on Open Parliaments has finally been translated from its original Portuguese to English. There are many reasons to read Cristiano’s piece, one of them being the scarcity of literature dealing with the usage of ICT by the legislative branch. I was honoured to be invited to write the preface to this book, in which I list a few other reasons why I think this book is very worthwhile reading. I have reproduced the preface below, with the addition of some hyperlinks.

***

Towards the end of the 18th Century, not long after the French Revolution, engineer Claude Chappe invented the optical telegraph. Also known as the Napoleonic Telegraph, this technological innovation enabled the transmission of messages over great distances at unprecedented speeds for its time. This novelty did not go unnoticed by the intellectuals of the period: the possibility of establishing a telegraph network that could connect individuals at high speed and lowered costs was seen as a unique opportunity for direct democracy to flourish.

The difficulties associated with direct democracy, so eloquently expressed by Rousseau just a few years earlier, no longer seemed relevant: simply opening the code used by the telegraph operators would suffice for a whirlpool of ideas to flow between citizens and government, bringing a new era of participatory decision-making. Events, however, took a different turn, and as time went by the enthusiasm for a democratic renewal faded away.

In the course of the centuries that followed, similar stories abounded. The emergence of each new ICT gave rise to a period of enthusiasm surrounding a renewal in politics and government, only to be followed by bitter disillusionment. While the causes of these historical experiences are multiple, it is safe to say that the failure of these technologies to deliver their much-heralded potential is underscored by a lack of understanding of the role of political institutions. These institutions are, inexorably, sources of obstacles and challenges that go beyond the reach of technological solutions.

Indeed, one could argue that despite the historical evidence, even today a certain amount of ingenuity permeates the majority of academic works in the domain of electronic democracy and open government, overestimating technological innovation and neglecting the role of institutions, actors, and their respective strategies.

Not falling prey to the techno-determinist temptation but rather carrying out an analysis grounded in institutions, organizational processes and actors’ strategies, is one of the many strengths of Cristiano Faria’s work. His experience as a civil servant in the Brazilian House of Representatives and his academic rigour bring together qualities that are rarely combined in the literature about the public sector. The result is a work that offers an unusual vision, taking into account a wide range of factors involved in processes of technological enactment and institutional innovation.

While underpinning the book as a whole, this encompassing perspective is most prominent in Chapters 4 and 5, in the case studies on the experiences from Brazil (e-Democracy) and Chile (Virtual Senator). Motivating factors, constraints, and institutional and organizational arrangements are brought to light. The reader encounters elements and processes that often go unperceived by even the most attentive observers and experienced academics.

For instance, while analysing the Brazilian case, Cristiano underscores the essential role played by legislative consultants in channelling citizens’ input into the formal decision-making processes of the House of Representatives. Only an individual who is viscerally familiar with the functioning of the public institutions in question is capable of such an insight – one of many throughout the book.

Even for this reason alone, this work is of inestimable value to the Brazilian and international literature in the fields of electronic democracy and open government. Numerous other characteristics, however, further add to its worth for researchers, politicians, civil servants and ordinary citizens with an interest in these subjects.

The object of study is relevant in itself. There is a disproportionate shortage of literature about the role of technologies with regard to the legislative branch. An incomplete understanding of how public institutions operate and interact among themselves has led an increasing number of academics and observers to focus their attention on the executive branch. Furthermore, in the limited literature that is available about the use of technologies by the legislative, the majority of studies are disappointingly superficial or excessively descriptive.

Cristiano’s text, although rich in detail, never loses sight of the major theoretical and normative perspectives that inform the state of the art in the electronic democracy debate. The literature that guides this piece is impeccable. This is a text that brings the reader into contact with the main theories and arguments relating to issues of transparency, participation, actors’ strategies, and processes of institutional and technological innovation.

Lastly, by presenting cases ranging from New Zealand to the Catalan Parliaments, this book has the inestimable worth of being a historical record, immune to temporal and technological changes. Cristiano Faria captures the state of the art in electronic democracy experiences in the legislative at the beginning of the 21st century. To ensure that the destiny of these experiences differs from that of the Napoleonic Telegraph, a realistic and perspicacious reflection is necessary, to which this book makes its contribution.

The Uncertain Relationship Between Open Data and Accountability

My article in response to Yu and Robinson’s recent paper on open data has just been published in the UCLA Law Review Discourse: The Uncertain Relationship Between Open Data and Accountability: A Response to Yu and Robinson’s The New Ambiguity of “Open Government”

Below is the abstract:

By looking at the nature of data that may be disclosed by governments, Harlan Yu and David Robinson provide an analytical framework that evinces the ambiguities underlying the term “open government data.” While agreeing with their core analysis, I contend that the authors ignore the enabling conditions under which transparency may lead to accountability, notably the publicity and political agency conditions. I argue that the authors also overlook the role of participatory mechanisms as an essential element in unlocking the potential for open data to produce better government decisions and policies. Finally, I conduct an empirical analysis of the publicity and political agency conditions in countries that have launched open data efforts, highlighting the challenges associated with open data as a path to accountability.

As I wrote the article, it became even more evident to me that the challenges for open data resemble those of democracy. To be successful, both depend on free press, fair elections, and multiple avenues of citizen participation. The resemblance goes one step further: both are most needed where they are least likely to thrive. On democracy and challenging environments, political scientist Robert Dahl wrote:

Democracy, it appears, is a bit chancy.  But its chances also depend on what we do ourselves.  Even if we cannot count on benign forces to favor democracy, we are not mere victims of blind forces over which we have no control. With adequate understanding of what democracy requires and the will to meet its requirements, we can act to preserve and, what is more, to advance democratic ideas and practices

May Dahl’s call resonate with the open data movement.

Towards Open Government in Nepal

Screen Shot 2013-03-27 at 15.43.16

On March 28-29, 2011, Freedom Forum, in collaboration with the World Bank, organized Nepal’s first National Convention on the Right to Information in Kathmandu in an effort to draw high level attention to issues affecting implementation of the RTI law and to build broad consensus to strengthen the RTI regime. The convention brought together over 150 practitioners, including senior Government of Nepal officials, members of the Constituent Assembly, and civil society leaders. (…) These discussions were anchored in a series of thematic papers prepared for the Convention focusing on the challenges facing the NIC, public agencies, and information officers in implementing the new law; the role of the press, citizens, and local government in activating the demand for information across society; the legal regime governing the RTI particularly the classification and exemptions regime and the nature of the constitutional guarantee for RTI; and the role of RTI in curbing corruption and democratising political parties. These papers constitute the centre-piece of this volume

Read the full volume here [PDF].

Citizen Engagement – Seven Questions, One Conversation

(cross posted from the World Bank’s Voices Blog)

Calls for increased citizen empowerment are heard from across the spectrum, ranging from governments and donors to CSOs and multilateral efforts such as the Open Government Partnership.

The World Bank Group, in partnership withCIVICUS, the Government of Finland andInterAction will host a conference on citizen engagement on March 18, 2013 to highlight the value of engaging with citizens for effective development.

The Citizen Voices conference will focus on citizen engagement and feedback systems that strengthen the quality of policy making and service delivery, where the impact on the poor is most direct. The conference aims to explore how citizen engagement is essential for effective development, move from knowledge to action, and establish concrete partnerships for scaling up at global and national levels.

But while the claims for citizen engagement abound, less discussion is dedicated to how to design and implement participatory processes that deliver their expected benefits, such as increased accountability and better delivery of policies and services. As part of this problem, not enough attention is paid to the various outcomes that participatory processes may engender and what they mean for policy and development.

For instance, in some cases participation may lead to disappointing results, such as citizens’ mistrust of government, elite capture and public opinion polarization. Conversely, participation can also be associated with surprisingly positive outcomes, such as increased levels of tax compliance and reduced infant mortality. But how can we explain these disparities in results?

Shedding light on the question of when, why and how participation works is precisely the objective of this conversation. Thus, to kick off the debate, I would like to start by considering seven questions:

  • How can we measure the success of citizen engagement initiatives?
  • How essential are processes of organizational and institutional change?
  • Can political will towards increased participation be stimulated?
  • What role does organized civil society play in citizen engagement processes?
  • How can we foster inclusiveness and what are the impacts of different methods of participant selection (e.g. open, randomized)?
  • Can we learn anything from the private sector about listening to external audiences?
  • What is the actual role of technology (if any) in participatory processes?

Parallel to the event, and running until the end of this month, the World Bank has launched an online conversation on citizen engagement to help tackling these and other issues. Needless to say, the questions are far from exhaustive. Maybe some are even secondary. But I believe that considering them might bring us closer to answering an even more fundamental question: that is, how can we leverage the dispersed knowledge of citizens to shape decisions that affect their lives?

Join the conversation on Striking Poverty and follow the conference live on World Bank Live.

Open Government and Democracy

The International Budget Partnership (IBP) has recently released the results of the Open Budget Survey 2012, which measures “the state of budget transparency, participation and oversight in 100 countries around the world”. In the survey report, the authors highlighted the positive relationship between budget transparency and democracy:

A democratic political system is a significant factor that supports budget transparency (…) In fact, a switch from autocracy to democracy is typically associated with an improvement in a country’s OBI score by almost 20 points, after controlling for other variables. In addition, transparency seems to depend much more on current levels of democracy than on how long a country has been a democracy: for countries in transition, this means that rapid improvements in transparency can be achieved without having to wait for slow processes of learning and adaptation.

This adds to a growing body of literature showing that democracies (and electoral competition) are indeed more transparent than other types of regime. If the relationship between democracy and openness comes across as obvious, it also opens space for some questions about the open government movement and its strategy to promote transparency.

Screen Shot 2013-03-07 at 00.42.12

Political Rights and Civil Liberties in 2013 – Freedom House

Transparency, it seems, is one of the vital signs of well-functioning democracies. Chronic lack of transparency, on the other hand, emerges as the symptom of flawed democracies or authoritarian regimes. If this logic is correct (and the evidence suggests it is) advocating for transparency would correspond to treating the symptoms of a disease, rather than preventing it in the first place.

This is not to say that promoting transparency reforms (e.g. open data, open budgets) is a useless act. Treating a symptom is not a problem in itself: it alleviates the pain and may even prevent further complications. But neglecting to treat the cause of the symptom is surely a bad practice.

This begs a fundamental question: are open government advocates efficiently channelling their energy and resources when asking for more transparency from governments that have little or no inclination to democracy? Or are they failing to strike a balance which combines a focus on transparency with more fundamental reforms that promote, for instance, free, fair and competitive elections?

Granted, transparency and democracy are mutually reinforcing: it is difficult to think of a democracy without informed consent. And even well-established democracies still have a long way to go towards more transparency. But, for instance, going as far as considering that open government may blossom in non-democracies seems questionable to me. All the technology and transparency in the world is unlikely to realize its full potential in the absence of fundamental political rights and civil liberties.

It might be time to start focusing on the role that political regimes play in promoting values that are dear to the open government movement, such as transparency, participation and collaboration. And democracy – or lack thereof – is the elephant in the room.

***

Further reading

Alt, J. E., Lassen, D. D., & Rose, S. (2005). “The causes of fiscal transparency: Evidence from the US States.” IMF Staff Papers, 53(Special Issue), 30–57.

Alt, J. E., & Lowry, R. C. (2010). “Transparency and accountability: Empirical results for US States.” Journal of Theoretical Politics, 22(4), 379–406.

Hollyer, J. R., Rosendorff, B. P., & Vreeland, J. R. (2011). “Democracy and transparency.” Journal of Politics, 73(4), 1191–1205.

Rosendorff, B. Peter, and James Raymond Vreeland. (2004). “Democracy and Data Dissemination: The Effect of Political Regime on Transparency.” Working Paper, Yale. 

Rosendorff, B. Peter and Doces, John A. (2006). “Democracy and Transparency”. Swiss Political Science Review, 12 (3), 99-112.

Wehner, J. and de Renzio, P. (2013) “Citizens, Legislators, and Executive Disclosure: The Political Determinants of Fiscal Transparency.” World Development, 41, 96-108.

The Way to Randomized Controlled Trials in Open Government

As I have written before, we may start to see a growing number of studies using randomized controlled trials (RCTs) to assess the validity of claims for transparency and participation. And in fact some donors in the open government space have already started to ask for RCT evaluations as a component of projects to be funded. But they might be skipping some important steps. A brief comment from the Simply Statistics blog suggests that a sequential approach (with RCTs at the end rather than at the start) might be more appropriate and cost-effective:

A really nice example where epidemiological studies are later confirmed by a randomized trial. From a statistician’s point of view, this is the idealized way that science would work. First, data that are relatively cheap (observational/retrospective studies) are used to identify potential associations of interest. After a number of these studies show a similar effect, a randomized study is performed to confirm what we suspected from the cheaper studies.

I think this consideration is particularly important for those funding open government evaluation work. Before jumping on the RCT bandwagon, one should first look at pre-existing knowledge to consider which questions are to be asked. But having followed the #opengov conversation for a while, I’d say this doesn’t happen very often.  

Unequal Participation: Open Government’s Unresolved Dilemma

( cross-posted from techPresident)

In my frequent conversations about open government and citizen participation, the subject of elite capture (or “how representative it is”) is almost unavoidable. Some go as far as evaluating participatory initiatives on the grounds of an ideal notion of representativeness: participants should perfectly mirror the socio-demographic traits of the larger population from which they come.

But oddly enough, the same people who raise these concerns about participatory initiatives are much less inclined to apply the same reasoning and standards to traditional politics. In other words, few take the time to consider how representative and inclusive existing electoral democracy actually is. An article by Nicholas Carnes at the New York Times about political representation in the United States puts the issue into perspective:

If millionaires were a political party, that party would make up roughly 3 percent of American families, but it would have a super-majority in the Senate, a majority in the House, a majority on the Supreme Court and a man in the White House. If working-class Americans were a political party, that party would have made up more than half the country since the start of the 20th century. But legislators from that party (those who last worked in blue-collar jobs before entering politics) would never have held more than 2 percent of the seats in Congress.

I’ve yet to see a participatory process that produces similar results. But the limits of representation do not stop there. African Americans and Latinos are still greatly under-represented in US politics. The gender issue is no different: with the House of Representatives only 17 percent women, the Inter Parliamentary Union ranks the US 82nd in female representation in politics, behind countries such as the Arab Emirates, Sudan, Mauritania and Kazakhstan.

Obviously, the US is by no means exceptional in exclusion. Those working in the field of political participation have long been aware of the excluding effect of representative systems. As put by political scientist Arend Lijphart, unequal participation remains as representative democracy’s “unresolved dilemma.” Even more unfortunately, underlines Lijphart, inequalities in representation and influence “are not randomly distributed, but systematically biased in favor of more privileged citizens (…) and against less advantaged citizens”.

And it is from this unresolved dilemma that the raison d’être of participatory innovations stems. But rather than a replacement for representative systems (as misunderstood by some), participatory innovations are complementary mechanisms to enable the participation of individuals who are systematically excluded from traditional politics, ultimately increasing the overall diversity of voices that influence government.

This observation leads to a fundamental issue when assessing citizen participation initiatives: beyond questioning demographic representativeness, one must also consider the extent to which initiatives succeed (or not) in promoting the participation of previously marginalized sectors of society (i.e. inclusiveness).

So how inclusive are these mechanisms?

To continue with the US example, let’s consider one of the most exciting open government events taking place at the local level in the US: the recent adoption of participatory budgeting in NYC. Unlike most overhyped #opengov experiences, a team of researchers carried out an evaluation of the experience looking at, among other things, the extent to which it promoted inclusiveness. Below are some excerpts from the report [PDF]:

  • Twenty percent of PB voters identified themselves as African American; 14 percent as Hispanic or Latino/a; 2 percent as Asian and 2 percent as “Other.”
  • A higher percentage of African Americans participated in neighborhood assemblies (38 percent), compared to the full population in the four districts (31 percent).
  • Twenty-one percent of budget delegates and 19 percent of PB voters were born outside of the United States.
  • Participants that identified themselves as Black/African American were the most likely to volunteer to be budget delegates.
  • Women represented 64 percent of neighborhood assembly participants, 65 percent of budget delegates and 62 percent of voters in the PB process.

But how these numbers compare with participation in traditional politics is probably one of the highlights of the evaluation (emphasis is mine):

One of the most striking findings about who participated in PB [participatory budgeting] is how the data compares to other types of civic engagement, particularly voting patterns in NYC elections. Across the districts, PB engaged communities that have traditionally been uninspired by politics. People of color, low-income people and some immigrant groups turned out at higher rates than in previous elections.

A few numbers worth noting:

Latino/as represented 39 percent of voters in the 2009 City Council elections. However, 50 percent of PB voters identified themselves as Latino/a (District 8 NYC).

Black or African Americans represented 79 percent of voters in 2009 City Council elections. However, 87 percent of the district’s PB voters identified themselves as Black or African American (District 45 NYC).

Twenty-two percent of PB voters had a household income of less than $10,000 compared to 4 percent of the district’s voters in the 2009 City Council election (District 8 NYC).

I have very little doubt, if any, that the contrast would be even starker if we compared the income of those who sit on the City Council and those who participated in the NYC participatory budgeting. In City Councils across the US, less than 10 percent of members come from a blue-collar background. Conversely, the numbers on income of participatory budgeting participants speak for themselves.

As citizen engagement gains traction in the open government agenda, inclusiveness should be one of the top priorities: both from normative and empirical standpoints, more inclusive initiatives are likely to produce better outcomes. The NYC experience provides valuable lessons for donors, policymakers, advocates, and enthusiasts alike. They can find more about it here and here.

Democratic Innovation in Open Government

The Oregon Citizen’s Initiative Review is without doubt one of the most interesting recent innovations in the field of citizen engagement.

Here’s an excerpt from Participedia on the initiative:

The Oregon Citizen Initiative Review (Oregon CIR) is a Citizens’ Initiative Review designed to allow citizens of the U.S. state of Oregon to evaluate statewide ballot initiatives. A Citizens’ Initiative Review (CIR) is a Citizens’ Jury that deliberates about a ballot initiative. The Oregon CIR is intended to give voters clear, useful, and trustworthy evaluations of initiatives on the ballot. (…)

The Oregon CIR involves four categories of participants: panelists, the citizens who deliberate about a ballot initiative; advocates, individuals who are knowledgeable about the ballot initiative and who argue in support of or in opposition to the ballot initiative; stakeholders, individuals who will be affected by the ballot initiative, who also argue in support of or in opposition to the ballot initiative; and background witnesses, individuals who are knowledgeable about issues related to the initiative, and who present neutral background information about those issues to the panelists. (…)

I have written before about different methods of participant selection, and this is one of the strong points of this initiative:

To select the panelists for the 2010 Oregon CIRs, HDO used the following selection process: HDO took a probability sample of 10,000 Oregon voters. All voters in this sample were sent an invitation to participate in the 2010 Oregon CIR and a demographic survey. Three hundred fifty members of the sample responded, for a response rate of 3.5%. From those who responded, HDO, using the demographic data from the sample survey, anonymously chose 24 panelists, and 5 alternate panelists, for each 2010 Oregon CIR. The panelists and alternates for each CIR were chosen using stratification, so that each panel closely matched the Oregon population in terms of place of residence, political partisanship, education, ethnicity/race, gender, and age.

If advocates and policymakers in the open government space are really serious about citizen engagement, this is the sort of institutional innovation they should be looking at. Unfortunately, this doesn’t seem to be happening.

Find out more about it at http://healthydemocracy.org/

High-Frequency Data Using Mobile Phones: Incentives and Accountability

Great research note  [PDF] by Croke et al. (2012). Here’s the abstract:

As mobile phone ownership rates have risen dramatically in Africa, there has been increased interest in using mobile telephones as a data collection platform. This note draws on two largely successful pilot projects in Tanzania and South Sudan that used mobile phones for high-frequency data collection. Data were collected on a wide range of topics and in a manner that was cost-effective, flexible, and rapid. Once households were included in the survey, they tended to stick with it: respondent fatigue has not been a major issue. While attrition and nonresponse have been challenges in the Tanzania survey, these were due to design flaws in that particular survey, challenges that can be avoided in future similar projects. Ensuring use of the data to demand better service delivery and policy decisions turned out to be as challenging as collecting the high-quality data. Experiences in Tanzania suggest that good data can be translated into public accountability, but also demonstrate that just putting data out in the public domain is not enough. This note discusses lessons learned and offers suggestions for future applications of mobile phone surveys in developing countries, such as those planned for the World Bank’s “Listening to Africa” initiative.

Of particular interest to me is the fact that part of the design used financial incentives as a means to reduce nonresponse and attrition rates. In the technology and development world there has been lots of talk about “incentives to participate”, where the practical shortcut is often the provision of financial incentives. In Tanzania, for instance, the authors report that “respondents who successfully completed an interview were rewarded with an amount varying from $2 to $4″, not a negligible sum in the Tanzanian context.

Interestingly, in the working paper [PDF] from which this note is drawn, a footnote sheds some light on how effective these rewards were:

Remarkably in both Sudan and Tanzania the amount of the reward did not have a discernable impact on response rates.

But these findings are not as surprising as they may seem. Indeed, there is a good deal of evidence from behavioural economics pointing out that financial incentives might not work as well as traditional economics (and economists) would predict.

And a noteworthy excerpt on the limits of transparency and the role of existing institutions and actors:

One lesson is that  providing citizens with relevant, timely, and accurate data  about the actions of politicians, policy makers, and public service providers is not sufficient. For the data to have impact, they need to be accessible and disseminated widely, and in ways that allow them to be utilized by already existing institutions and actors.

This is an interesting point, although I am not sure to what extent existing institutions are enough. In the field of technology and governance, I believe that it has become quite clear that very little is achieved when technological solutions are not coupled with institutional innovations.

But that’s another story. In any case, a great read, and the type of effort that is badly needed in this space.