Priceless? Estimating the cost of open government reforms

costing

Results for Development has just published “Priceless?”, a report commissioned by the World Bank that develops a new, practical framework for estimating the full (economic) costs of open government programs (full disclosure: I have been minimally involved with the project at some of its stages). The framework is used to conduct a cost analysis of two cases: i) the well-known Ukrainian ProZorro e-procurement program, and ii) Sierra Leone’s Open Data Program. The final estimated costs might surprise some, but I will avoid spoilers at this stage.

The report is authored by the brilliant Praneetha Vissapragada and Naomi Joswiak and edited by none other than Nathaniel Heller and Courtney Tolmie. While much has been written about the potential benefits of open government reforms, much less has been dedicated to their respective costs. This new publication is a welcome addition towards addressing that gap, and will be a valuable resource for policymakers, practitioners and advocates working in the open government space.

 

New IDS Journal – 9 Papers in Open Government

2016-01-14 16.51.09_resized

The new IDS Bulletin is out. Edited by Rosemary McGee and Duncan Edwards, this is the first open access version of the well-known journal by the Institute of Development Studies. It brings eight new studies looking at a variety of open government issues, ranging from uptake in digital platforms to government responsiveness in civic tech initiatives. Below is a brief presentation of this issue:

Open government and open data are new areas of research, advocacy and activism that have entered the governance field alongside the more established areas of transparency and accountability. In this IDS Bulletin, articles review recent scholarship to pinpoint contributions to more open, transparent, accountable and responsive governance via improved practice, projects and programmes in the context of the ideas, relationships, processes, behaviours, policy frameworks and aid funding practices of the last five years. They also discuss questions and weaknesses that limit the effectiveness and impact of this work, offer a series of definitions to help overcome conceptual ambiguities, and identify hype and euphemism. The contributions – by researchers and practitioners – approach contemporary challenges of achieving transparency, accountability and openness from a wide range of subject positions and professional and disciplinary angles. Together these articles give a sense of what has changed in this fast-moving field, and what has not – this IDS Bulletin is an invitation to all stakeholders to take stock and reflect.

The ambiguity around the ‘open’ in governance today might be helpful in that its very breadth brings in actors who would otherwise be unlikely adherents. But if the fuzzier idea of ‘open government’ or the allure of ‘open data’ displace the task of clear transparency, hard accountability and fairer distribution of power as what this is all about, then what started as an inspired movement of governance visionaries may end up merely putting a more open face on an unjust and unaccountable status quo.

Among others, the journal presents an abridged version of a paper by Jonathan Fox and myself on digital technologies and government responsiveness (for full version download here).

Below is a list of all the papers:

Rosie McGee, Duncan Edwards
Tiago Peixoto, Jonathan Fox
Katharina Welle, Jennifer Williams, Joseph Pearce
Miguel Loureiro, Aalia Cassim, Terence Darko, Lucas Katera, Nyambura Salome
Elizabeth Mills
Laura Neuman
David Calleb Otieno, Nathaniel Kabala, Patta Scott-Villiers, Gacheke Gachihi, Diana Muthoni Ndung’u
Christopher Wilson, Indra de Lanerolle
Emiliano Treré

 

World Development Report 2016: Digital Dividends

nationalgeographic_1746433-wblive (1)

The World Development Report 2016, the main annual publication of the World Bank, is out. This year’s theme is Digital Dividends, examining the role of digital technologies in the promotion of development outcomes. The findings of the WDR are simultaneously encouraging and sobering. Those skeptical of the role of digital technologies in development might be surprised by some of the results presented in the report. Technology advocates from across the spectrum (civic tech, open data, ICT4D) will inevitably come across some facts that should temper their enthusiasm.

While some may disagree with the findings, this Report is an impressive piece of work, spread across six chapters covering different aspects of digital technologies in development: 1) accelerating growth, 2) expanding opportunities, 3) delivering services, 4) sectoral policies, 5) national priorities, 6) global cooperation. My opinion may be biased, as somebody who made some modest contributions to the Report, but I believe that, to date, this is the most thorough effort to examine the effects of digital technologies on development outcomes. The full report can be downloaded here.

The report draws, among other things, from 14 background papers that were prepared by international experts and World Bank staff. These background papers serve as additional reading for those who would like to examine certain issues more closely, such as social media, net neutrality, and the cybersecurity agenda.

For those interested in citizen participation and civic tech, one of the papers written by Prof. Jonathan Fox and myself – When Does ICT-Enabled Citizen Voice Lead to Government Responsiveness? – might be of particular interest. Below is the abstract:

This paper reviews evidence on the use of 23 information and communication technology (ICT) platforms to project citizen voice to improve public service delivery. This meta-analysis focuses on empirical studies of initiatives in the global South, highlighting both citizen uptake (‘yelp’) and the degree to which public service providers respond to expressions of citizen voice (‘teeth’). The conceptual framework further distinguishes between two trajectories for ICT-enabled citizen voice: Upwards accountability occurs when users provide feedback directly to decision-makers in real time, allowing policy-makers and program managers to identify and address service delivery problems – but at their discretion. Downwards accountability, in contrast, occurs either through real time user feedback or less immediate forms of collective civic action that publicly call on service providers to become more accountable and depends less exclusively on decision-makers’ discretion about whether or not to act on the information provided. This distinction between the ways in which ICT platforms mediate the relationship between citizens and service providers allows for a precise analytical focus on how different dimensions of such platforms contribute to public sector responsiveness. These cases suggest that while ICT platforms have been relevant in increasing policymakers’ and senior managers’ capacity to respond, most of them have yet to influence their willingness to do so.

You can download the paper here.

Any feedback on our paper or models proposed (see below, for instance) would be extremely welcome.

unpacking

unpacking user feedback and civic action: difference and overlap

I also list below the links to all the background papers and their titles

Enjoy the reading.

Social Accountability: What Does the Evidence Really Say?

So what does the evidence about citizen engagement say? Particularly in the development world it is common to say that the evidence is “mixed”. It is the type of answer that, even if correct in extremely general terms, does not really help those who are actually designing and implementing citizen engagement reforms.

This is why a new (GPSA-funded) work by Jonathan Fox, “Social Accountability: What does the Evidence Really Say” is a welcome contribution for those working with open government in general and citizen engagement in particular. Rather than a paper, this work is intended as a presentation that summarizes (and disentangles) some of the issues related to citizen engagement.

Before briefly discussing it, some definitional clarification. I am equating “social accountability” with the idea of citizen engagement given Jonathan’s very definition of  social accountability:

“Social accountability strategies try to improve public sector performance by bolstering both citizen engagement and government responsiveness”

In short, according to this definition, social accountability is defined, broadly, as “citizen participation” followed by government responsiveness, which encompasses practices as distinct as FOI law campaigns, participatory budgeting and referenda.

But what is new about Jonathan’s work? A lot, but here are three points that I find particularly important, based on a very personal interpretation of his work.

First, Jonathan makes an important distinction between what he defines as “tactical” and “strategic” social accountability interventions. The first type of interventions, which could also be called “naïve” interventions, are for instance those bounded in their approach (one tool-based) and those that assume that mere access to information (or data) is enough. Conversely, strategic approaches aim to deploy multiple tools and articulate society-side efforts with governmental reforms that promote responsiveness.

This distinction is important because, when examining the impact evaluation evidence, one finds that while the evidence is indeed mixed for tactical approaches, it is much more promising for strategic approaches. A blunt lesson to take from this is that when looking at the evidence, one should avoid comparing lousy initiatives with more substantive reform processes. Otherwise, it is no wonder that “the evidence is mixed.”

Second, this work makes an important re-reading of some of the literature that has found “mixed effects”, reminding us that when it comes to citizen engagement, the devil is in the details. For instance, in a number of studies that seem to say that participation does not work, when you look closer you will not be surprised that they do not work. And many times the problem is precisely the fact that there is no participation whatsoever. False negatives, as eloquently put by Jonathan.

Third, Jonathan highlights the need to bring together the “demand” (society) and “supply” (government) sides of governance. Many accountability interventions seem to assume that it is enough to work on one side or the other, and that an invisible hand will bring them together. Unfortunately, when it comes to social accountability it seems that some degree of “interventionism” is necessary in order to bridge that gap.

Of course, there is much more in Jonathan’s work than that, and it is a must read for those interested in the subject. You can download it here [PDF].

10 Most Read Posts in 2013

Below is a selection of the 10 most read posts at DemocracySpot in 2013. Thanks to all of those who stopped by throughout the year, and happy 2014.

1. Does transparency lead to trust? Some evidence on the subject.

2. The Foundations of Motivation for Citizen Engagement

3. Open Government, Feedback Loops, and Semantic Extravaganza

4. Open Government and Democracy

5. What’s Wrong with e-Petitions and How to Fix them

6. Lawrence Lessig on Sortition and Citizen Participation

7. Unequal Participation: Open Government’s Unresolved Dilemma

8. The Effect of SMS on Participation: Evidence from Uganda

9. The Uncertain Relationship Between Open Data and Accountability

10. Lisbon Revisited: Notes on Participation

Does transparency lead to trust? Some evidence on the subject.

As open government gains traction in the international agenda, it is increasingly common to come across statements that assume a causal relationship in which transparency leads to trust in government. But to what extent are claims that transparency leads to trust backed up by evidence?

Judging from some recent publications on the subject, such a relationship is not as straightforward as sadvocates would like. In fact, in a number of cases, the evidence points in another direction: that is, transparency may ultimately decrease trust.

Below is a brief overview of research that has been carried out on the subject:

Transparency has been trumpeted by many as the key to trust in government. The assumption is that if government organisations open up and show the public what decisions are made, how they are made and what the results are, people will automatically have more trust in government. But does transparency really lead to more trust? Or will it only provide critical citizens with more information to blame government again and again for small mistakes? Transparency and Trustexamines the effects of transparency on trust in a government organisation. By using an experimental method this study moves beyond normative or correlational research on transparency. In doing so, causal inferences regarding the relation between transparency and trust are allowed. Several objects of transparency and dimensions of information are being put to the test in three experiments. The experiments show that transparency is merely a ‘hygiene factor’: it does not contribute to higher levels of trust and it can even lead to lower levels of trust if people are disappointed with the degree to which government is transparent. This conclusion challenges current overly optimistic assumptions concerning the effect of transparency on trust.

Building on the notion of transparency as a strong democratic value and theories of procedural justice, this article reports an explorative experimental test whether transparency in decision making may lead to increased perceived legitimacy in terms of decision acceptance and trust. This is done in a context of difficult decisions of high importance for citizens – namely priority setting in public health care. An experiment was designed in which ordinary citizens were presented with a description of a case of priority setting between two groups with different health care needs. One group was given no information at all on the decision-making procedure, as an example of non-transparent decision making, and six groups were presented with different descriptions of the decision-making procedure, as examples of transparency in decision making. The transparent procedures were derived from three basic forms of democratic decision making: representation, direct participation and expert decision making. A second manipulation framed the decision-making procedure alternatively in positive or negative terms in order to capture media framing effects as well. According to the findings of the study, transparent decision-making procedures tend to weaken rather than strengthen general trust in health care – a finding that might reveal obstacles to attempts to strengthen the legitimacy of health care by employing transparent procedures. The results also show that while the form of decision making had no significant impact on perceived legitimacy, positive or negative framing of a decision-making procedure influences public perceptions of both the procedure and the decision outcome.

Of course, the impact of transparency on trust may vary according to the context:

 Transparency is considered a key value for trustworthy governments. However, the effect of transparency on citizens’ trust across national cultures is overlooked in current research. This article compares the effect of transparency on trust in government in the Netherlands and South Korea. The effect is investigated in two similar series of three experiments. The authors hypothesize that the effect of transparency differs because the countries have different cultural values regarding power distance and short- and long-term orientation. Results reveal similar patterns in both countries: transparency has a subdued and sometimes negative effect on trust in government. However, the negative effect in South Korea is much stronger. The difference in the magnitude of transparency’s effect suggests that national cultural values play a significant role in how people perceive and appreciate government transparency.

But some evidence goes even further, suggesting that transparency may have a demobilizing effect on citizens. And, if context matters, such a demobilizing effect might be particularly strong in the context of developing countries:

International organizations, policy experts, and nongovernmental organizations promote greater governmental transparency as a crucial reform to enhance accountability and curb corruption. Transparency is predicted to deter corruption in part by expanding the possibilities for public or societal accountability, that is, for citizens and citizens associations to monitor, scrutinize, and act to hold public office holders to account. Although the societal accountability mechanism linking transparency and good government is often implied, it builds on a number of assumptions seldom examined empirically. This article unpacks the assumptions of principal-agent theories of accountability and suggests that the logic of collective action can be used to understand why exposure of egregious and endemic corruption may instead demobilize the demos (i.e., resignation) rather than enhance accountability (i.e., indignation). We explore these theoretical contentions and examine how transparency affects three indicators of indignations versus resignation—institutional trust, political involvement, and political interest—given different levels of corruption. The empirical analyses confirm that an increase in transparency in highly corrupt countries tends to breed resignation rather than indignation.

Democratic theory often assumes that offering more information to voters will enhance electoral accountability. However, it is unclear whether corruption information translates into higher political participation and increased support for challengers. For example, information on corruption could lower the utility one gets from participating in elections at all. We provide experimental evidence that such information not only decreases incumbent support in local elections in Mexico, but also decreases voter turnout and challengers’ votes, as well as erodes partisan attachments. Our results suggest that while information clearly is necessary to improve accountability, corruption information is not necessarily suficient, since voters may respond to it by withdrawing from the political process.

Surely, transparency remains an essential – although quite insufficient – ingredient of accountability. On the trust issue, one could easily think of a number of scenarios in which it is actually better that citizens do not trust their governments. In fact, systems of checks and balances and oversight institutions are not specifically conceived under the logic of trust. Quite on the contrary, such institutional designs assume some level of suspicion vis-à-vis governments: as put in the Federalist Paper No. 51, “If angels were to govern men, neither external nor internal controls on government would be necessary.”

Granted, in some cases a perfect world in which citizens trust their governments may well be desirable. It may even be that transparency leads – in the long run – to increased trust: a great way to sell transparency to governments. But if we want to walk the talk of evidence-based policymaking, we may consider dropping the trust rhetoric. At least for now.

The Uncertain Relationship Between Open Data and Accountability

My article in response to Yu and Robinson’s recent paper on open data has just been published in the UCLA Law Review Discourse: The Uncertain Relationship Between Open Data and Accountability: A Response to Yu and Robinson’s The New Ambiguity of “Open Government”

Below is the abstract:

By looking at the nature of data that may be disclosed by governments, Harlan Yu and David Robinson provide an analytical framework that evinces the ambiguities underlying the term “open government data.” While agreeing with their core analysis, I contend that the authors ignore the enabling conditions under which transparency may lead to accountability, notably the publicity and political agency conditions. I argue that the authors also overlook the role of participatory mechanisms as an essential element in unlocking the potential for open data to produce better government decisions and policies. Finally, I conduct an empirical analysis of the publicity and political agency conditions in countries that have launched open data efforts, highlighting the challenges associated with open data as a path to accountability.

As I wrote the article, it became even more evident to me that the challenges for open data resemble those of democracy. To be successful, both depend on free press, fair elections, and multiple avenues of citizen participation. The resemblance goes one step further: both are most needed where they are least likely to thrive. On democracy and challenging environments, political scientist Robert Dahl wrote:

Democracy, it appears, is a bit chancy.  But its chances also depend on what we do ourselves.  Even if we cannot count on benign forces to favor democracy, we are not mere victims of blind forces over which we have no control. With adequate understanding of what democracy requires and the will to meet its requirements, we can act to preserve and, what is more, to advance democratic ideas and practices

May Dahl’s call resonate with the open data movement.