At the intersection of participation and technology. By Tiago C. Peixoto. Opinions are my own and do not reflect those of any institutions with which I am or have been affiliated.
Results for Development has just published “Priceless?”, a report commissioned by the World Bank that develops a new, practical framework for estimating the full (economic) costs of open government programs (full disclosure: I have been minimally involved with the project at some of its stages). The framework is used to conduct a cost analysis of two cases: i) the well-known Ukrainian ProZorro e-procurement program, and ii) Sierra Leone’s Open Data Program. The final estimated costs might surprise some, but I will avoid spoilers at this stage.
The report is authored by the brilliant Praneetha Vissapragada and Naomi Joswiak and edited by none other than Nathaniel Heller and Courtney Tolmie. While much has been written about the potential benefits of open government reforms, much less has been dedicated to their respective costs. This new publication is a welcome addition towards addressing that gap, and will be a valuable resource for policymakers, practitioners and advocates working in the open government space.
The new IDS Bulletin is out. Edited by Rosemary McGee and Duncan Edwards, this is the first open access version of the well-known journal by the Institute of Development Studies. It brings eight new studies looking at a variety of open government issues, ranging from uptake in digital platforms to government responsiveness in civic tech initiatives. Below is a brief presentation of this issue:
Open government and open data are new areas of research, advocacy and activism that have entered the governance field alongside the more established areas of transparency and accountability. In this IDS Bulletin, articles review recent scholarship to pinpoint contributions to more open, transparent, accountable and responsive governance via improved practice, projects and programmes in the context of the ideas, relationships, processes, behaviours, policy frameworks and aid funding practices of the last five years. They also discuss questions and weaknesses that limit the effectiveness and impact of this work, offer a series of definitions to help overcome conceptual ambiguities, and identify hype and euphemism. The contributions – by researchers and practitioners – approach contemporary challenges of achieving transparency, accountability and openness from a wide range of subject positions and professional and disciplinary angles. Together these articles give a sense of what has changed in this fast-moving field, and what has not – this IDS Bulletin is an invitation to all stakeholders to take stock and reflect.
The ambiguity around the ‘open’ in governance today might be helpful in that its very breadth brings in actors who would otherwise be unlikely adherents. But if the fuzzier idea of ‘open government’ or the allure of ‘open data’ displace the task of clear transparency, hard accountability and fairer distribution of power as what this is all about, then what started as an inspired movement of governance visionaries may end up merely putting a more open face on an unjust and unaccountable status quo.
Among others, the journal presents an abridged version of a paper by Jonathan Fox and myself on digital technologies and government responsiveness (for full version download here).
The World Development Report 2016, the main annual publication of the World Bank, is out. This year’s theme is Digital Dividends, examining the role of digital technologies in the promotion of development outcomes. The findings of the WDR are simultaneously encouraging and sobering. Those skeptical of the role of digital technologies in development might be surprised by some of the results presented in the report. Technology advocates from across the spectrum (civic tech, open data, ICT4D) will inevitably come across some facts that should temper their enthusiasm.
While some may disagree with the findings, this Report is an impressive piece of work, spread across six chapters covering different aspects of digital technologies in development: 1) accelerating growth, 2) expanding opportunities, 3) delivering services, 4) sectoral policies, 5) national priorities, 6) global cooperation. My opinion may be biased, as somebody who made some modest contributions to the Report, but I believe that, to date, this is the most thorough effort to examine the effects of digital technologies on development outcomes. The full report can be downloaded here.
The report draws, among other things, from 14 background papers that were prepared by international experts and World Bank staff. These background papers serve as additional reading for those who would like to examine certain issues more closely, such as social media, net neutrality, and the cybersecurity agenda.
This paper reviews evidence on the use of 23 information and communication technology (ICT) platforms to project citizen voice to improve public service delivery. This meta-analysis focuses on empirical studies of initiatives in the global South, highlighting both citizen uptake (‘yelp’) and the degree to which public service providers respond to expressions of citizen voice (‘teeth’). The conceptual framework further distinguishes between two trajectories for ICT-enabled citizen voice: Upwards accountability occurs when users provide feedback directly to decision-makers in real time, allowing policy-makers and program managers to identify and address service delivery problems – but at their discretion. Downwards accountability, in contrast, occurs either through real time user feedback or less immediate forms of collective civic action that publicly call on service providers to become more accountable and depends less exclusively on decision-makers’ discretion about whether or not to act on the information provided. This distinction between the ways in which ICT platforms mediate the relationship between citizens and service providers allows for a precise analytical focus on how different dimensions of such platforms contribute to public sector responsiveness. These cases suggest that while ICT platforms have been relevant in increasing policymakers’ and senior managers’ capacity to respond, most of them have yet to influence their willingness to do so.
Rio Grande do Sul Participatory Budgeting Voting System (2014)
Within the open government debate, there is growing interest in the role of technology in citizen engagement. However, as interest in the subject grows, so does the superficiality of the conversations that follow. While the number of citizen engagement and technology events is increasing, the opportunities for in-depth conversations on the subject do not seem to be increasing at the same rate.
This is why, a few weeks ago, I was pleased to visit the University of Westminster for a kick-off talk on “Technology and Participation: Friend or Foe?”, organized by Involve and the Centre for the Study of Democracy (Westminster). It was a pleasure to start a conversation with a group that was willing to engage in a longer and more detailed conversation on the subject.
My talk covered a number of issues that have been keeping me busy recently. On the preliminary quantitative work that I presented, credit should also go to the awesome team that I am working with, which includes Fredrik Sjoberg (NYU), Jonathan Mellon (Oxford) and Paolo Spada (UBC / Harvard). For those who would like to see some of the graphs better, I have also added here [PDF] the slides of my presentation.
I have skipped the video to the beginning of my talk, but the discussion that followed is what made the event interesting. In my opinion, the contributions of Maria Nyberg (Head of Open Policy Making at the Cabinet Office) Catherine Howe (Public-i), as well as those of the participants, were a breath of fresh air in the current citizen engagement conversation. So please bear with me and watch until the end.
I would like to thank Simon Burral (Involve) and Graham Smith (Westminster) for their invitation. Simon leads the great work being done at Involve, one of the best organizations working on citizen engagement nowadays. And to keep it short, Graham is the leading thinker when the issue is democratic innovations.
Below is also an excellent summary by Sonia Bussu (Involve), capturing some of the main points of my talk and the discussion that ensued (originally posted here).
***
“On technology and democracy
The title of yesterday’s event, organised by Involve and Westminster University’s Centre for the Study of Democracy, posed a big question, which inevitably led to several other big questions, as the discussion among a lively audience of practitioners, academics and policymakers unfolded (offline and online).
Tiago Peixoto, from the World Bank, kicked off the debate and immediately put the enthusiasm for new technologies into perspective. Back in 1795, the very first model of the telegraph, the Napoleonic semaphore, raised hopes for – and fears of – greater citizen engagement in government. Similarly the invention of the TV sparked debates on whether technology would strengthen or weaken democracy, increasing citizen awareness or creating more opportunities for market and government manipulation of public opinion.
Throughout history, technological developments have marked societal changes, but has technological innovation translated into better democracy? What makes us excited today about technology and participation is the idea that by lowering the transaction costs we can increase people’s incentives to participate. Tiago argued that this costs-benefits rationale doesn’t explain why people continue to vote, since the odds of their vote making a difference are infinitesimal (to be fair voter turnouts are decreasing across most advanced democracies – although this is more a consequence of people’s increasing cynicism towards political elites rather than their understanding of mathematical probabilities).*
So do new technologies mobilise more people or simply normalise the participation of those that already participate? The findings on the matter are still conflicting. Tiago showed us some data on online voting in Rio Grande do Sul participatory budgeting process in Brazil, whereby e-voting would seem to bring in new voters (supporting the mobilisation hypothesis) but from the same social strata (e.g. higher income and education – as per the normalisation hypothesis).
In short, we’re still pretty much confused about the impact of technology on democracy and participation. Perhaps, as suggested by Tiago and Catherine Howe from Public-i, the problem is that we’re focusing too much on technology, tempted by the illusion it offers to simplify and make democracy easy. But the real issue lies elsewhere, in understanding people and policymakers’ incentives and the articulation (or lack thereof) between technologies and democratic institutions. As emphasised by Catherine, technology without democratic evolution is like “lipstick on a pig”.
The gap between institutions and technology is still a big obstacle. Catherine reminded us how participation often continues to translate into one-way communication in government’s engagement strategies, which constrains the potential of new technologies in facilitating greater interaction between citizens and institutions and coproduction of policies as a response to increasing complexity. As academics and practitioners pitch the benefits of meaningful participation to policy makers, Tiago asked whether a focus on instrumental incentives might help us move forward. Rather than always pointing to the normative argument of deepening democracy, we could start using data from cases of participatory budgeting to show how greater participation reduces tax evasion and corruption as well as infant mortality.
He also made a methodological point: we might need to start using more effectively the vast array of data on existing engagement platforms to understand incentives to participation and people’s motivation. We might get some surprises, as findings demystify old myths. Data from Fix My Street would seem to prove that government response to issues raised doesn’t increase the likelihood of future participation by as much as we would assume (28%).** But this is probably a more complicated story, and as pointed out by some people in the audience the nature and salience of both the issue and the response will make a crucial difference.
Catherine highlighted one key problem: when we talk about technology, we continue to get stuck on the application layer, but we really need to be looking at the architecture layer. A democratic push for government legislation over the architecture layer is crucial for preserving the Internet as a neutral space where deeper democracy can develop. Data is a big part of the architecture and there is little democratic control over it. An understanding of a virtual identity model that can help us protect and control our data is key for a genuinely democratic Internet.
Maria Nyberg, from the Cabinet Office, was very clear that technology is neither friend nor foe: like everything, it really depends on how we use it. Technology is all around us and can’t be peripheral to policy making. It offers great opportunities to civil servants as they can tap into data and resources they didn’t have access to before. There is a recognition from government that it doesn’t have the monopoly on solutions and doesn’t always know best. The call is for more open policy making, engaging in a more creative and collaborative manner. Technology can allow for better and faster engagement with people, but there is no silver bullet.
Some people in the audience felt that the drive for online democracy should be citizen-led, as the internet could become the equivalent of a “bloodless guillotine” for politicians. But without net neutrality and citizen control over our own data there might be little space for genuine participation.
*This point was edited on 12/07/2014 following a conversation with Tiago.
** This point was edited on 12/07/2014 following a conversation with Tiago.”
—————————
I am also thankful to the UK Political Studies Association (PSA), Involve and the University of Westminster for co-sponsoring my travel to the UK. I will write more later on about the Scaling and Innovation Conference organized by the PSA, where I was honored to be one of the keynote speakers along with MP Chi Onwurah (Shadow Cabinet Office Minister) and Professor Stephen Coleman (Leeds).
So what does the evidence about citizen engagement say? Particularly in the development world it is common to say that the evidence is “mixed”. It is the type of answer that, even if correct in extremely general terms, does not really help those who are actually designing and implementing citizen engagement reforms.
This is why a new (GPSA-funded) work by Jonathan Fox, “Social Accountability: What does the Evidence Really Say” is a welcome contribution for those working with open government in general and citizen engagement in particular. Rather than a paper, this work is intended as a presentation that summarizes (and disentangles) some of the issues related to citizen engagement.
Before briefly discussing it, some definitional clarification. I am equating “social accountability” with the idea of citizen engagement given Jonathan’s very definition of social accountability:
“Social accountability strategies try to improve public sector performance by bolstering both citizen engagement and government responsiveness”
In short, according to this definition, social accountability is defined, broadly, as “citizen participation” followed by government responsiveness, which encompasses practices as distinct as FOI law campaigns, participatory budgeting and referenda.
But what is new about Jonathan’s work? A lot, but here are three points that I find particularly important, based on a very personal interpretation of his work.
First, Jonathan makes an important distinction between what he defines as “tactical” and “strategic” social accountability interventions. The first type of interventions, which could also be called “naïve” interventions, are for instance those bounded in their approach (one tool-based) and those that assume that mere access to information (or data) is enough. Conversely, strategic approaches aim to deploy multiple tools and articulate society-side efforts with governmental reforms that promote responsiveness.
This distinction is important because, when examining the impact evaluation evidence, one finds that while the evidence is indeed mixed for tactical approaches, it is much more promising for strategic approaches. A blunt lesson to take from this is that when looking at the evidence, one should avoid comparing lousy initiatives with more substantive reform processes. Otherwise, it is no wonder that “the evidence is mixed.”
Second, this work makes an important re-reading of some of the literature that has found “mixed effects”, reminding us that when it comes to citizen engagement, the devil is in the details. For instance, in a number of studies that seem to say that participation does not work, when you look closer you will not be surprised that they do not work. And many times the problem is precisely the fact that there is no participation whatsoever. False negatives, as eloquently put by Jonathan.
Third, Jonathan highlights the need to bring together the “demand” (society) and “supply” (government) sides of governance. Many accountability interventions seem to assume that it is enough to work on one side or the other, and that an invisible hand will bring them together. Unfortunately, when it comes to social accountability it seems that some degree of “interventionism” is necessary in order to bridge that gap.
Of course, there is much more in Jonathan’s work than that, and it is a must read for those interested in the subject. You can download it here [PDF].
As open government gains traction in the international agenda, it is increasingly common to come across statements that assume a causal relationship in which transparency leads to trust in government. But to what extent are claims that transparency leads to trust backed up by evidence?
Judging from some recent publications on the subject, such a relationship is not as straightforward as sadvocates would like. In fact, in a number of cases, the evidence points in another direction: that is, transparency may ultimately decrease trust.
Below is a brief overview of research that has been carried out on the subject:
Transparency has been trumpeted by many as the key to trust in government. The assumption is that if government organisations open up and show the public what decisions are made, how they are made and what the results are, people will automatically have more trust in government. But does transparency really lead to more trust? Or will it only provide critical citizens with more information to blame government again and again for small mistakes? Transparency and Trustexamines the effects of transparency on trust in a government organisation. By using an experimental method this study moves beyond normative or correlational research on transparency. In doing so, causal inferences regarding the relation between transparency and trust are allowed. Several objects of transparency and dimensions of information are being put to the test in three experiments. The experiments show that transparency is merely a ‘hygiene factor’: it does not contribute to higher levels of trust and it can even lead to lower levels of trust if people are disappointed with the degree to which government is transparent. This conclusion challenges current overly optimistic assumptions concerning the effect of transparency on trust.
Building on the notion of transparency as a strong democratic value and theories of procedural justice, this article reports an explorative experimental test whether transparency in decision making may lead to increased perceived legitimacy in terms of decision acceptance and trust. This is done in a context of difficult decisions of high importance for citizens – namely priority setting in public health care. An experiment was designed in which ordinary citizens were presented with a description of a case of priority setting between two groups with different health care needs. One group was given no information at all on the decision-making procedure, as an example of non-transparent decision making, and six groups were presented with different descriptions of the decision-making procedure, as examples of transparency in decision making. The transparent procedures were derived from three basic forms of democratic decision making: representation, direct participation and expert decision making. A second manipulation framed the decision-making procedure alternatively in positive or negative terms in order to capture media framing effects as well. According to the findings of the study, transparent decision-making procedures tend to weaken rather than strengthen general trust in health care – a finding that might reveal obstacles to attempts to strengthen the legitimacy of health care by employing transparent procedures. The results also show that while the form of decision making had no significant impact on perceived legitimacy, positive or negative framing of a decision-making procedure influences public perceptions of both the procedure and the decision outcome.
Of course, the impact of transparency on trust may vary according to the context:
Transparency is considered a key value for trustworthy governments. However, the effect of transparency on citizens’ trust across national cultures is overlooked in current research. This article compares the effect of transparency on trust in government in the Netherlands and South Korea. The effect is investigated in two similar series of three experiments. The authors hypothesize that the effect of transparency differs because the countries have different cultural values regarding power distance and short- and long-term orientation. Results reveal similar patterns in both countries: transparency has a subdued and sometimes negative effect on trust in government. However, the negative effect in South Korea is much stronger. The difference in the magnitude of transparency’s effect suggests that national cultural values play a significant role in how people perceive and appreciate government transparency.
But some evidence goes even further, suggesting that transparency may have a demobilizing effect on citizens. And, if context matters, such a demobilizing effect might be particularly strong in the context of developing countries:
International organizations, policy experts, and nongovernmental organizations promote greater governmental transparency as a crucial reform to enhance accountability and curb corruption. Transparency is predicted to deter corruption in part by expanding the possibilities for public or societal accountability, that is, for citizens and citizens associations to monitor, scrutinize, and act to hold public office holders to account. Although the societal accountability mechanism linking transparency and good government is often implied, it builds on a number of assumptions seldom examined empirically. This article unpacks the assumptions of principal-agent theories of accountability and suggests that the logic of collective action can be used to understand why exposure of egregious and endemic corruption may instead demobilize the demos (i.e., resignation) rather than enhance accountability (i.e., indignation). We explore these theoretical contentions and examine how transparency affects three indicators of indignations versus resignation—institutional trust, political involvement, and political interest—given different levels of corruption. The empirical analyses confirm that an increase in transparency in highly corrupt countries tends to breed resignation rather than indignation.
Democratic theory often assumes that offering more information to voters will enhance electoral accountability. However, it is unclear whether corruption information translates into higher political participation and increased support for challengers. For example, information on corruption could lower the utility one gets from participating in elections at all. We provide experimental evidence that such information not only decreases incumbent support in local elections in Mexico, but also decreases voter turnout and challengers’ votes, as well as erodes partisan attachments. Our results suggest that while information clearly is necessary to improve accountability, corruption information is not necessarily suficient, since voters may respond to it by withdrawing from the political process.
Surely, transparency remains an essential – although quite insufficient – ingredient of accountability. On the trust issue, one could easily think of a number of scenarios in which it is actually better that citizens do not trust their governments. In fact, systems of checks and balances and oversight institutions are not specifically conceived under the logic of trust. Quite on the contrary, such institutional designs assume some level of suspicion vis-à-vis governments: as put in the Federalist Paper No. 51, “If angels were to govern men, neither external nor internal controls on government would be necessary.”
Granted, in some cases a perfect world in which citizens trust their governments may well be desirable. It may even be that transparency leads – in the long run – to increased trust: a great way to sell transparency to governments. But if we want to walk the talk of evidence-based policymaking, we may consider dropping the trust rhetoric. At least for now.
By looking at the nature of data that may be disclosed by governments, Harlan Yu and David Robinson provide an analytical framework that evinces the ambiguities underlying the term “open government data.” While agreeing with their core analysis, I contend that the authors ignore the enabling conditions under which transparency may lead to accountability, notably the publicity and political agency conditions. I argue that the authors also overlook the role of participatory mechanisms as an essential element in unlocking the potential for open data to produce better government decisions and policies. Finally, I conduct an empirical analysis of the publicity and political agency conditions in countries that have launched open data efforts, highlighting the challenges associated with open data as a path to accountability.
As I wrote the article, it became even more evident to me that the challenges for open data resemble those of democracy. To be successful, both depend on free press, fair elections, and multiple avenues of citizen participation. The resemblance goes one step further: both are most needed where they are least likely to thrive. On democracy and challenging environments, political scientist Robert Dahl wrote:
Democracy, it appears, is a bit chancy. But its chances also depend on what we do ourselves. Even if we cannot count on benign forces to favor democracy, we are not mere victims of blind forces over which we have no control. With adequate understanding of what democracy requires and the will to meet its requirements, we can act to preserve and, what is more, to advance democratic ideas and practices
May Dahl’s call resonate with the open data movement.