A Review of the Evidence on Open Budgeting

Brand new.

“A Review of the Evidence on Open Budgeting” is a recent report by the World Bank Institute’sCapacity Development and Results team. It explores key questions and existing evidence around the impact of open budgeting. Despite the growing body of literature, there remains limited substantiation for whether and how open budgeting contributes to reductions in poverty and improvements in the lives of the poor. This report pieces together the results chain presenting evidence for and against from the literature. It explores links between open budgeting and indicators of impact such as human development and public service delivery. The findings highlight the importance of measuring budget transparency, accountability, and participation. The findings show that the impact of institutional changes differ under varying conditions in specific contexts. The conclusions of the report point to the need for further investigation into impact and establishing effective measurement practices for monitoring related institutional change under varying conditions and different contexts.”

You can download the report here [PDF].

Participation, Transparency and Accountability: Innovations in South Korea, Brazil, and the Philippines

A report by Brian Wampler for the Global Initiative for Fiscal Transparency (GIFT):

Citizen participation in budgetary and other fiscal processes has been expanding at international, national, and local levels over the past 15 years. The direct participation of citizens, it is hoped, will improve governance, limit misuse of public funds, and produce more informed, engaged citizens. At the national level, reformist governments now encourage the direct engagement of citizens during multiple moments of the policy cycle—from initial policy formulation to the oversight of policy implementation. Reformist governments hope to take advantage of increased citizen participation to increase their legitimacy, thus allowing them to change spending and policy priorities, increase state effectiveness by make public bureaucrats more responsive to citizens and elected officials, and, finally, ensure that the quality of public services improves. During the 1980s and 1990s, many subnational governments took advantage of policy decentralization to experiment with new institutional types. Direct citizen participation has been most robust at subnational levels due to the decreased costs and the greater direct impact of citizens on policymaking.

(….)

The main purpose of this report is to examine how three countries, South Korea, Brazil, and the Philippines, have made extensive efforts to create new institutions and policies that encourage the participation of citizens and CSOs in complex policy processes. South Korea developed an institutional arrangement based on policy experts, CSOs, and the Korean Development Institute. Brazil uses a model that relies extensively on the participation of citizens at multiple tiers of government. Finally, the Philippines use a mixed model that incorporates citizens and CSOs at national and subnational levels

(….)

Political reformers seeking to incorporate greater numbers of people into policymaking venues face a series of challenges. These include: (1) asymmetrical access to information as well as differing skills base to interpret information; (2) the difficultly of decision-making when groups grow in size; (3) a reduction in the importance of any single participant due to the greater number of participants; (4) political contestation over who has the right to participate; (5) who are the legitimate representatives of different groups; and (6) higher organizational costs (time, money, personnel). This report maps out how new participatory institutions and programs that are designed to help governments and their civil society allies draw citizens directly into decision-making processes.To explain the variation in the type of participatory experiences now used by different countries,we identify four factors that most strongly affect the types of participation-oriented reforms as well as the results. These four factors include: (a) presidential-level support for reform, (b) the configuration of civil society, (c) state capacity and (d) the geo-political direction of reform (topdown/center –periphery vs. bottom-up/periphery/center. It is the combination of these four factors that most strongly explains the type of institutions adopted in each of these countries.

Read the full report here [PDF]. 

10 Most Read Posts in 2013

Below is a selection of the 10 most read posts at DemocracySpot in 2013. Thanks to all of those who stopped by throughout the year, and happy 2014.

1. Does transparency lead to trust? Some evidence on the subject.

2. The Foundations of Motivation for Citizen Engagement

3. Open Government, Feedback Loops, and Semantic Extravaganza

4. Open Government and Democracy

5. What’s Wrong with e-Petitions and How to Fix them

6. Lawrence Lessig on Sortition and Citizen Participation

7. Unequal Participation: Open Government’s Unresolved Dilemma

8. The Effect of SMS on Participation: Evidence from Uganda

9. The Uncertain Relationship Between Open Data and Accountability

10. Lisbon Revisited: Notes on Participation

Open Budgets in Africa: Tokenistic?

Matt Andrews recently posted an interesting analysis in his blog. Measuring the difference in transparency between budget formulation and budget execution, Matt finds that “Most countries have a gap between the scores they get in transparency of budget preparation and transparency of budget execution. Indeed, 63% of the countries have more transparency in budget formulation than in budget execution.” And he concludes that “countries with higher OBI scores tend to have relatively bigger gaps than the others—so that I am led to believe that countries generally focus on improving transparency in formulation to get better scores (with efforts to make execution getting less attention).” He has also written a second post about it and the IBP folks have replied to him here.

***

Also read

Open Government and Democracy 

The Uncertain Relationship Between Open Data and Accountability

Documentary: Participatory Budgeting in Belo Horizonte

Through the Facebook Participatory Budgeting group I came across a documentary about Belo Horizonte’s PB. The documentary, by Joao Ramos de Almeida, provides a unique view of the functioning of one of the oldest PBs in Brazil.

Among other things, the documentary shows how the process leads to a degree of civic empowerment and activism rarely seen in traditional governing models. It is particularly interesting to see how citizens contest, for instance, the cost estimates of public works made by the city administration. The documentary also shows how PB manages to engage citizens in an extremely time consuming process. It is also interesting to see that, while there is some degree of deliberation in the PB process, much of it is also about negotiation between the different communities involved.

Among other things, it shows that Belo Horizonte’s PB is far from perfect, and the suspicion of some degree of co-optation of some PB participants by the administration highlights difficulties that are inherent to many participatory processes. To some, it might come across as a sobering message. Yet, when looking at participatory initiatives, we should not only compare their functioning to an ideal vision of democracy. In this case, we should also compare it to the status quo, that is, how public budgeting takes place in the absence of public participation.

For those interested in citizen engagement this documentary (English subtitles, 55 mins) is worth watching.

***

Also read

Participatory Budgeting and Digital Democracy: the Belo Horizonte Case

The Effects of Participatory Budgeting on Infant Mortality in Brazil

Participatory Budgeting: Seven Defining Characteristics

Participatory Budgeting and Technology: Innovations in Open Government

The Participatory Turn: Participatory Budgeting Comes to America

Does transparency lead to trust? Some evidence on the subject.

As open government gains traction in the international agenda, it is increasingly common to come across statements that assume a causal relationship in which transparency leads to trust in government. But to what extent are claims that transparency leads to trust backed up by evidence?

Judging from some recent publications on the subject, such a relationship is not as straightforward as sadvocates would like. In fact, in a number of cases, the evidence points in another direction: that is, transparency may ultimately decrease trust.

Below is a brief overview of research that has been carried out on the subject:

Transparency has been trumpeted by many as the key to trust in government. The assumption is that if government organisations open up and show the public what decisions are made, how they are made and what the results are, people will automatically have more trust in government. But does transparency really lead to more trust? Or will it only provide critical citizens with more information to blame government again and again for small mistakes? Transparency and Trustexamines the effects of transparency on trust in a government organisation. By using an experimental method this study moves beyond normative or correlational research on transparency. In doing so, causal inferences regarding the relation between transparency and trust are allowed. Several objects of transparency and dimensions of information are being put to the test in three experiments. The experiments show that transparency is merely a ‘hygiene factor’: it does not contribute to higher levels of trust and it can even lead to lower levels of trust if people are disappointed with the degree to which government is transparent. This conclusion challenges current overly optimistic assumptions concerning the effect of transparency on trust.

Building on the notion of transparency as a strong democratic value and theories of procedural justice, this article reports an explorative experimental test whether transparency in decision making may lead to increased perceived legitimacy in terms of decision acceptance and trust. This is done in a context of difficult decisions of high importance for citizens – namely priority setting in public health care. An experiment was designed in which ordinary citizens were presented with a description of a case of priority setting between two groups with different health care needs. One group was given no information at all on the decision-making procedure, as an example of non-transparent decision making, and six groups were presented with different descriptions of the decision-making procedure, as examples of transparency in decision making. The transparent procedures were derived from three basic forms of democratic decision making: representation, direct participation and expert decision making. A second manipulation framed the decision-making procedure alternatively in positive or negative terms in order to capture media framing effects as well. According to the findings of the study, transparent decision-making procedures tend to weaken rather than strengthen general trust in health care – a finding that might reveal obstacles to attempts to strengthen the legitimacy of health care by employing transparent procedures. The results also show that while the form of decision making had no significant impact on perceived legitimacy, positive or negative framing of a decision-making procedure influences public perceptions of both the procedure and the decision outcome.

Of course, the impact of transparency on trust may vary according to the context:

 Transparency is considered a key value for trustworthy governments. However, the effect of transparency on citizens’ trust across national cultures is overlooked in current research. This article compares the effect of transparency on trust in government in the Netherlands and South Korea. The effect is investigated in two similar series of three experiments. The authors hypothesize that the effect of transparency differs because the countries have different cultural values regarding power distance and short- and long-term orientation. Results reveal similar patterns in both countries: transparency has a subdued and sometimes negative effect on trust in government. However, the negative effect in South Korea is much stronger. The difference in the magnitude of transparency’s effect suggests that national cultural values play a significant role in how people perceive and appreciate government transparency.

But some evidence goes even further, suggesting that transparency may have a demobilizing effect on citizens. And, if context matters, such a demobilizing effect might be particularly strong in the context of developing countries:

International organizations, policy experts, and nongovernmental organizations promote greater governmental transparency as a crucial reform to enhance accountability and curb corruption. Transparency is predicted to deter corruption in part by expanding the possibilities for public or societal accountability, that is, for citizens and citizens associations to monitor, scrutinize, and act to hold public office holders to account. Although the societal accountability mechanism linking transparency and good government is often implied, it builds on a number of assumptions seldom examined empirically. This article unpacks the assumptions of principal-agent theories of accountability and suggests that the logic of collective action can be used to understand why exposure of egregious and endemic corruption may instead demobilize the demos (i.e., resignation) rather than enhance accountability (i.e., indignation). We explore these theoretical contentions and examine how transparency affects three indicators of indignations versus resignation—institutional trust, political involvement, and political interest—given different levels of corruption. The empirical analyses confirm that an increase in transparency in highly corrupt countries tends to breed resignation rather than indignation.

Democratic theory often assumes that offering more information to voters will enhance electoral accountability. However, it is unclear whether corruption information translates into higher political participation and increased support for challengers. For example, information on corruption could lower the utility one gets from participating in elections at all. We provide experimental evidence that such information not only decreases incumbent support in local elections in Mexico, but also decreases voter turnout and challengers’ votes, as well as erodes partisan attachments. Our results suggest that while information clearly is necessary to improve accountability, corruption information is not necessarily suficient, since voters may respond to it by withdrawing from the political process.

Surely, transparency remains an essential – although quite insufficient – ingredient of accountability. On the trust issue, one could easily think of a number of scenarios in which it is actually better that citizens do not trust their governments. In fact, systems of checks and balances and oversight institutions are not specifically conceived under the logic of trust. Quite on the contrary, such institutional designs assume some level of suspicion vis-à-vis governments: as put in the Federalist Paper No. 51, “If angels were to govern men, neither external nor internal controls on government would be necessary.”

Granted, in some cases a perfect world in which citizens trust their governments may well be desirable. It may even be that transparency leads – in the long run – to increased trust: a great way to sell transparency to governments. But if we want to walk the talk of evidence-based policymaking, we may consider dropping the trust rhetoric. At least for now.

The Uncertain Relationship Between Open Data and Accountability

My article in response to Yu and Robinson’s recent paper on open data has just been published in the UCLA Law Review Discourse: The Uncertain Relationship Between Open Data and Accountability: A Response to Yu and Robinson’s The New Ambiguity of “Open Government”

Below is the abstract:

By looking at the nature of data that may be disclosed by governments, Harlan Yu and David Robinson provide an analytical framework that evinces the ambiguities underlying the term “open government data.” While agreeing with their core analysis, I contend that the authors ignore the enabling conditions under which transparency may lead to accountability, notably the publicity and political agency conditions. I argue that the authors also overlook the role of participatory mechanisms as an essential element in unlocking the potential for open data to produce better government decisions and policies. Finally, I conduct an empirical analysis of the publicity and political agency conditions in countries that have launched open data efforts, highlighting the challenges associated with open data as a path to accountability.

As I wrote the article, it became even more evident to me that the challenges for open data resemble those of democracy. To be successful, both depend on free press, fair elections, and multiple avenues of citizen participation. The resemblance goes one step further: both are most needed where they are least likely to thrive. On democracy and challenging environments, political scientist Robert Dahl wrote:

Democracy, it appears, is a bit chancy.  But its chances also depend on what we do ourselves.  Even if we cannot count on benign forces to favor democracy, we are not mere victims of blind forces over which we have no control. With adequate understanding of what democracy requires and the will to meet its requirements, we can act to preserve and, what is more, to advance democratic ideas and practices

May Dahl’s call resonate with the open data movement.

Open Government and Democracy

The International Budget Partnership (IBP) has recently released the results of the Open Budget Survey 2012, which measures “the state of budget transparency, participation and oversight in 100 countries around the world”. In the survey report, the authors highlighted the positive relationship between budget transparency and democracy:

A democratic political system is a significant factor that supports budget transparency (…) In fact, a switch from autocracy to democracy is typically associated with an improvement in a country’s OBI score by almost 20 points, after controlling for other variables. In addition, transparency seems to depend much more on current levels of democracy than on how long a country has been a democracy: for countries in transition, this means that rapid improvements in transparency can be achieved without having to wait for slow processes of learning and adaptation.

This adds to a growing body of literature showing that democracies (and electoral competition) are indeed more transparent than other types of regime. If the relationship between democracy and openness comes across as obvious, it also opens space for some questions about the open government movement and its strategy to promote transparency.

Screen Shot 2013-03-07 at 00.42.12

Political Rights and Civil Liberties in 2013 – Freedom House

Transparency, it seems, is one of the vital signs of well-functioning democracies. Chronic lack of transparency, on the other hand, emerges as the symptom of flawed democracies or authoritarian regimes. If this logic is correct (and the evidence suggests it is) advocating for transparency would correspond to treating the symptoms of a disease, rather than preventing it in the first place.

This is not to say that promoting transparency reforms (e.g. open data, open budgets) is a useless act. Treating a symptom is not a problem in itself: it alleviates the pain and may even prevent further complications. But neglecting to treat the cause of the symptom is surely a bad practice.

This begs a fundamental question: are open government advocates efficiently channelling their energy and resources when asking for more transparency from governments that have little or no inclination to democracy? Or are they failing to strike a balance which combines a focus on transparency with more fundamental reforms that promote, for instance, free, fair and competitive elections?

Granted, transparency and democracy are mutually reinforcing: it is difficult to think of a democracy without informed consent. And even well-established democracies still have a long way to go towards more transparency. But, for instance, going as far as considering that open government may blossom in non-democracies seems questionable to me. All the technology and transparency in the world is unlikely to realize its full potential in the absence of fundamental political rights and civil liberties.

It might be time to start focusing on the role that political regimes play in promoting values that are dear to the open government movement, such as transparency, participation and collaboration. And democracy – or lack thereof – is the elephant in the room.

***

Further reading

Alt, J. E., Lassen, D. D., & Rose, S. (2005). “The causes of fiscal transparency: Evidence from the US States.” IMF Staff Papers, 53(Special Issue), 30–57.

Alt, J. E., & Lowry, R. C. (2010). “Transparency and accountability: Empirical results for US States.” Journal of Theoretical Politics, 22(4), 379–406.

Hollyer, J. R., Rosendorff, B. P., & Vreeland, J. R. (2011). “Democracy and transparency.” Journal of Politics, 73(4), 1191–1205.

Rosendorff, B. Peter, and James Raymond Vreeland. (2004). “Democracy and Data Dissemination: The Effect of Political Regime on Transparency.” Working Paper, Yale. 

Rosendorff, B. Peter and Doces, John A. (2006). “Democracy and Transparency”. Swiss Political Science Review, 12 (3), 99-112.

Wehner, J. and de Renzio, P. (2013) “Citizens, Legislators, and Executive Disclosure: The Political Determinants of Fiscal Transparency.” World Development, 41, 96-108.

13 New Articles on Participatory Budgeting

A band inaugurates a public work selected through participatory budgeting in Brazil (picture by Prefeitura de Olinda on Flickr).

The new issue of the Journal of Public Deliberation (Volume 8, Issue 2 – 2012) presents 13 new articles on participatory budgeting. Edited by Janette Hartz-Karpz (Curtin University) and Brian Wampler (Boise State University) “This special issue of the Journal of Public Deliberation brings together leading scholars expand our conceptual tools to understand why PB programs are being adopted, how governments are adapting the rules and principles to meet different policy and political goals, and the impact of PB on civil society, state reform, and social well-being.”

Below links to the articles:

Transnational Models of Citizen Participation: The Case of Participatory Budgeting
Yves Sintomer, Carsten Herzberg, Anja Röcke, and Giovanni Allegretti

The Effects of Participatory Budgeting on Infant Mortality in Brazil

picture by Blog do Mílton Jung on Flickr

Adding pieces of evidence to the ROI of citizen participation. Highlights are mine:

Participatory budgeting, via which the common citizen is given the ability to interact with the elected politicians in the drafting of the local budget, became a popular political reform in Brazilian municipalities in the 1990s and attracted widespread attention across the world. This paper investigates whether the use of participatory budgeting in Brazilian municipalities in the period 1991-2004 has affected the pattern of municipal expenditures and had any measurable impact on living conditions. I show that the municipalities that made use of this participatory mechanism favoured an allocation of public expenditures that closely matched the ìpopular preferences and channeled a larger fraction of their total budget to key investments in sanitation and health services. I also found that this change in the composition of municipal expenditures is associated with a pronounced reduction in the infant mortality rates for municipalities which adopted participatory budgeting. This suggests that promoting a more direct interaction between service users and elected officials in budgetary design and implementation can affect both how local resources are spent and associated living standard outcomes.

You can read the full paper here [PDF].

Update:  The paper has been published in the World Development Journal. You can read the final version here [PDF].