Citizen Engagement: Two Learning Opportunities

For those willing to learn more about citizen engagement, here are two opportunities worth checking out.

The first one is the World Bank’s MOOC on Citizen Engagement. Even though the course has already started it is still possible to enroll. Here’s a brief description of the course:

The 4-week course brings together a diverse range of experts to provide students with a comprehensive overview of citizen engagement. It begins by synthesizing the theories and concepts that underlie citizen engagement, and goes on to explore how citizens can be engaged in both policymaking and public service delivery. Finally, it investigates how recent innovations are shaking up the field, through detailing both successes and failures of these new approaches. Our presenters, leaders in academia, government, and civil society, provide a wide range of perspectives and real-world experience to give participants a deeper understanding of whether citizen engagement can truly enhance the process of development. Participants will also have the opportunity to collaborate with one another and design their own citizen engagement initiatives, thereby putting theories learned in the course into practice.

This week starts module 2, with Matt Leighninger, Tina Nabatchi, Beth Noveck and myself:

This week explores the role that citizens can play in actively shaping public policy. We start by examining how citizens participate, analyzing the differences between ‘thick’ and ‘thin’ forms of engagement and asking strategic questions such as who should participate, how should participants interact with decision makers, what information do participants need, and how will participation impact policy decisions. Next, we survey examples of crowdsourcing and open innovation that are helping governments and citizens better interact. Finally, we unpack why citizens participate, moving beyond the mere calculation of costs and benefits described in the rational choice model to an analysis of broader factors that influence participation.

 

govlabcapture

The second opportunity is the coaching program on Citizen Engagement by the GovLab Academy, with Beth Noveck and myself. Here’s the description of the program:

This program is designed to help those wishing to integrate citizen engagement into ongoing projects. Whether policymaking or service delivery in nature, we start from the assumption that, engaging citizens is both more effective and more legitimate as a way of working. Engagement may be offline as well as on and local or widely distributed. But, in every case, teams should have a clear sense of the problem they are trying to solve, the rationale for why they believe greater openness to and collaboration with citizens can have a positive impact, and a willingness to measure impact. Convened by two practitioners/theorists of citizen engagement, the program with emphasize peer-to-peer coaching and introductions to relevant mentors and experts from around the world working on related problems or applying similar methods. Our goal? To have take more citizen engagement projects from idea to implementation. Everyone is invited to apply. There will be an admissions preference for those working at the city-level.

There’s a number of other awesome courses provided by the GovLab: you can check all of them here.

DemocracySpot’s Most Read Posts in 2014

Glasses for reading (1936) – Nationaal Archief

(I should have posted this on the 31st, but better late than never)

Below are some of the most read posts in 2014. While I’m at it, I’ll take the opportunity to explain the reduced number of posts in the last few months. Since mid-2014 I have been working with a small team of political and data scientists on a number of research questions at the intersection of technology and citizen engagement (I presented a few preliminary findings here). Following the period of field work, data collection and experiments, we have now started the drafting and peer-review stage of our research. This has been an extremely time-consuming process, which has taken up most of my weekends, when I generally write for this blog.

Still, one of my new year’s resolutions is precisely to better discipline myself to post more regularly. And I am hopeful that the publication of our upcoming research will make up for the recent reduction in posts. We will start to disseminate our results soon, so stay tuned.

In the meantime, here’s a selection of the five most read posts in 2014.

The Problem with Theory of Change

Technology and Citizen Engagement: Friend or Foe? 

A Brilliant Story of Participation, Technology and Development Outcomes

When Citizen Engagement Saves Lives (and what we can learn from it) 

Social Accountability: What Does the Evidence Really Say?

Over 40 Papers on Crowdsourcing for Politics & Policy

pic by James Cridland (flickr)

Today saw the beginning of the biennial conference on Internet, Politics and Policy, convened by the Oxford Internet Institute (University of Oxford) and OII-edited academic journal Policy and Internet. This year’s conference theme is Crowdsourcing for Politics and Policy. Skimming over some papers and abstracts,  here are some of my first (and rather superficial) impressions:

  • Despite the focus of the conference, there are few papers looking at an essential issue of crowdsourcing, namely its potential epistemic attributes. That is, when, why and how “the many are smarter than the few” and the role that technology plays in this.
  • In methodological terms, it seems that very little of the research presented takes advantage of the potential offered by ICT mediated processes when it comes to i) quantitative work with “administrative” data and ii) experimental research design.
  • On the issue of deliberation, it is good to see that more people are starting to look at design issues, slowly moving away from the traditional fixation on the Habermasian ideal (I’ve talked about this in a presentation here).
  • It seems that the majority of the papers focus on European experiences or those from other developed countries. At first, this is not surprising given the location of the conference and the resources that researchers from these countries have (e.g. travel budget). Yet, it may also suggest limited integration between North/South networks of researchers.

With regard to the last point above, it appears that there is a bridge yet to be built between the community of researchers represented by those attending this conference and the emerging community from the tech4accountability space. There’s lots of potential gain for both sides in engaging in a dialogue and, as importantly, a common language. The “Internet & Politics” community would benefit from the tech4accountability’s focus – although sometimes fuzzy – on development outcomes and experiences that emerge from the “South”. Conversely, the tech4accountability community would benefit a great deal by connecting with the existing (and clearly more mature) knowledge when it comes to the intersection of ICT, politics and citizen engagement.

Needless to say, all of the above are initial impressions and broad generalizations, and as such, may be unfair. The OII biennial conference remains, without a doubt, one of the major conferences in its field. You can view the full program of the conference here. I have also listed below in a simplified manner the links to the available papers of the conference according to their respective tracks.

Track A: Harnessing the Crowd

Experiments on Crowdsourcing Policy Assessmen

A Case Study in Modelling Government-Citizen Interaction in Facebook

The potential of Participedia as a crowdsourcing tool for comparative analysis of democratic innovations

Crowd Capital in Governance Contexts

Analyzing Crowd Discussion Towards a more complete model to measure and explain online deliberation

Predicting Events Using Learning Algorithms on Micro Blog Data

A Crowdsourcing Approach to Identify Common Method Bias and Self-Representation

Hate Speech, Machine Classification and Statistical Modelling of Information Flows on Twitter

Internet-mediated cooperative norm setting in the university

Monopsony and the Crowd: Labor for Lemons?

Online labour markets – leveling the playing field for international service markets?

TRACK B: Policy and Government

The Neo-Humanitarians: Assessing the Credibility of Organized Volunteer Crisis Mappers

Let The Users Be The Filter? Crowdsourced Filtering To Avoid Online Intermediary Liability

Regulating Distributed Peer-Production Infrastructures

Population as Auditor of an Election Process in Honduras: VotoSocial

Crowd-sourcing corruption: some challenges, some possible futures

Vertical crowdsourcing: The discourses of activity and the governance of crowds in emergency situations

TRACK C: Engaging the Crowd

What does crowdsourcing legislation entail for the participants? The Finnish case of Avoin Ministeriö

Let the crowd decide? Crowdsourcing ideas as an emerging form of multistakeholder participation

The question of technologically mediated civic political participation reformulated

Discussing Germany’s Future: The Evaluation of Federal Online Citizen Participation

Reprogramming power through crowdsourcing: time, space and citizenship in crowdsourcing for law in Finland

Crowdsourcing as Reflective Political Practice: Building a Location-based Tool for Civic Learning and Engagement

Civic crowdfunding as a marketplace for participation in urban development

Voices in the Noise: Crowdsourcing Public Opinion using Urban Pervasive Technologies

A Brilliant Story of Participation, Technology and Development Outcomes

Brazilian electronic voting machine

A major argument for democratic governance is that more citizen participation leads to better outcomes through an improved alignment between citizens’ preferences and policies. But how does that play out in practice? Looking at the effects of the introduction of electronic voting (EV) in Brazil, a paper by Thomas Fujiwara (Princeton) sheds light on this question. Entitled “Voting Technology, Political Responsiveness, and Infant Health: Evidence from Brazil” (2013), it is one of the best papers I’ve read when it comes to bringing together the issues of technology, participation and development outcomes.

Below is an extract from the paper:

This paper provides evidence on how improving political participation can lead to better service outcomes. It estimates the effects of an electronic voting, or EV, technology in reducing a mundane, but nonetheless important, obstacle to political participation: difficulty in operating ballots. The results indicate that EV caused a large de facto enfranchisement of less educated voters, which lead to the election of more left-wing state legislators, increased public health care spending, utilization (prenatal visits), and infant health (birth weight).

While filling out a ballot may be a trivial task to educated citizens in developed countries, the same is not true in Brazil, where 23% of adults are “unable to read or write a simple note” and 42% did not complete the 4th grade. Moreover, before 1994 Brazilian paper ballots required voters to write a candidate’s name or electoral number and involved only written instructions. This resulted in a substantial quantity of error-ridden and blank ballots being cast, generating a large number of residual votes (not assigned to a candidate and discarded from the tallying of results).

In the mid-1990’s, the Brazilian government developed an EV technology as a substitute for paper ballots. While its introduction aimed at reducing the time and costs of voting counting, other features of the technology, such as the use of candidates’ photographs as visual aids, the use of “error” messages for voters about to cast residual votes, and guiding the voting process step by step, facilitated voting and reduced errors.

(…) Estimates indicate that EV reduced residual voting in state legislature elections by a magnitude larger than 10% of total turnout. Such effect implies that millions of citizens who would have their votes go uncounted when using a paper ballot were de facto enfranchised. Consistent with the hypothesis that these voters were more likely to be less educated, the effects are larger in municipalities with higher illiteracy rates. Moreover, EV raises the vote shares of left-wing parties.

The paper will go on to argue that this enfranchisement of the less educated citizenry did indeed affect public policy. (…) I focus on  state government spending, in particular on an area that disproportionately affects the less educated: health care. Poorer Brazilians rely mostly on a public-funded system for health care services, which richer voters are substantially more likely to use the co-existing private services. The less educated have thus relatively stronger preferences for increased public health care provision, and political economy models predict that increasing their participation leads to higher public spending in this area.

Using data from birth records, I also find that EV raised the number of prenatal visits by women to health professionals and lowered the prevalence of low-weight births (below 2500g), and indicator of newborn health. Moreover, these results hold only for less educated mothers, and I find no effects for the more educated, supporting the interpretation that EV lead to benefits specifically targeted at poorer populations.

Fujiwara’s findings are great for a number of reasons, some of which I highlight below:

  • Participation and policy preferences: The findings in this paper support the argument for democratic governance, showing that an increase in the participation of poorer segments of society ultimately leads to better service results.
  • Institutions and context: The paper indirectly highlights how innovations are intrinsically linked to institutions and their context. For instance, as noted by Fujiwara, “the effect of EV is larger in the proportional representation races where a paper ballot requires writing down the name or number of the candidate (lower chamber of congress and state legislature) than in the plurality races where a paper ballot involves checking a box (senate, governor, and president).” In other words, the electoral system matters, and the Brazilian outcomes would be most likely to be replicated in countries with similar electoral processes (and levels of ballot complexity), rather than those adopting plurality voting systems. (If I remember well, this was one of the findings of a paper by Daniel Hidalgo (unpublished),  comparing the effects of e-voting in Brazil and India: the effects of e-voting for elections in the lower house in India [plurality vote] were smaller than in Brazil). In a similar vein, the effects of the introduction of similar technology would probably be lower in places with higher levels of educational attainment within poor segments of society.
  • Technology and elections: Much of the work on technology and accountability evolves around non-electoral activities that are insulated from existing processes and institutions, which tends to mitigate the chances of real-life impact. And, whether you like it or not, elections remain one of the most pervasive and consequential processes involving citizen participation in public affairs. There seems to be untapped potential for the use of technology to leverage electoral processes (beyond partisan campaigns). Finding ways to better inform voters (e.g. voting advice applications) and to lower the barriers for entry in electoral competition (why not a Rock the Vote for unlikely candidates?) are some of the paths that could be further explored. Fujiwara’s paper show how technology can enhance development outcomes by building on top of existing institutions.
  • Technology and inclusion: For a number of people working with development and public policy, a major concern with technology is the risk of exclusion of  marginalized groups. While that is a legitimate concern, this paper shows the opposite effect, reminding us that it is less about technology and more about the use that one makes of it.
  • Unintended effects: The use of technology in governance processes is full of stories of unintended effects. Most of them are negative ones, epitomized by the case of digitization of land records in Bangalore [PDF]: instead of transparency and efficiency, it led to increased corruption and inefficiencies. Fujiwara’s paper shows that unexpected benefits are also possible. While the primary goal of  the introduction of e-voting in Brazil was related to costs and time, another major unanticipated impact was better service outcomes. If unintended effects are often overlooked by practitioners and researchers alike, this paper highlights the need to look for effects beyond those originally intended.

All of these points, added to the methodological approach adopted by Fujiwara, are good reasons to read the paper. You can find it here [PDF].

New Book on 25 Years of Participatory Budgeting

Screenshot 2014-06-09 17.17.40

A little while ago I mentioned the launch of the Portuguese version of the book organized by Nelson Dias, “Hope for Democracy: 25 Years of Participatory Budgeting Worldwide”.

The good news is that the English version is finally out. Here’s an excerpt from the introduction:

This book represents the effort  of more than forty authors and many other direct and indirect contributions that spread across different continents seek to provide an overview on the Participatory Budgeting (PB) in the World. They do so from different backgrounds. Some are researchers, others are consultants, and others are activists connected to several groups and social movements. The texts reflect this diversity of approaches and perspectives well, and we do not try to influence that.

(….)

The pages that follow are an invitation to a fascinating journey on the path of democratic innovation in very diverse cultural, political, social and administrative settings. From North America to Asia, Oceania to Europe, from Latin America to Africa, the reader will find many reasons to closely follow the proposals of the different authors.

The book  can be downloaded here [PDF]. I had the pleasure of being one of the book’s contributors, co-authoring an article with Rafael Sampaio on the use of ICT in PB processes: “Electronic Participatory Budgeting: False Dilemmas and True Complexities” [PDF].

While my perception may be biased, I believe this book will be a major contribution for researchers and practitioners in the field of participatory budgeting and citizen engagement in general. Congratulations to Nelson Dias and all the others who contributed their time and energy.

The Problem with Theory of Change

picture by skreened.com

If you are working in the fields of development or governance it’s highly likely that you’ve come across the term “theory of change” (ToC). At a conference a couple of weeks ago, while answering some questions, I mentioned that I preferred not to use the term. The comment didn’t go unnoticed by some witty observers on Twitter, and I was surprised by the number of people who came to me afterwards asking why I do not “like” theory of change.

I can see why some people are attracted to the term. First, “change” is a powerful word: it even helps win elections. And when it comes to governance issues, the need for change is almost a consensus. Second, the user of the word “theory” gives scientific verve to the conversation. However, the problem is precisely the appropriateness of its use if one thinks of the word in scientific terms. It seems that people are saying “theory” when they actually mean (at best) “hypothesis”.

We don’t have to go very far to find out what scientific theory actually is. Keeping to information that is just a click away, let’s take one of the definitions reproduced in Wikipedia’s entry for “theory”:

A scientific theory is a well-substantiated explanation of some aspect of the natural world, based on a body of facts that have been repeatedly confirmed through observation and experiment. Such fact-supported theories are not “guesses” but reliable accounts of the real world.

 Or “scientific theory”:

A theory is a good theory if it satisfies two requirements: It must accurately describe a large class of observations on the basis of a model that contains only a few arbitrary elements, and it must make definite predictions about the results of future observations.

 And here’s a rap video on the difference between theory and hypothesis:

Granted, the word “theory” is often used as a synonym of “hypothesis”, and even dictionaries do so. But the problem of this in the context of current usages of “theory of change” is that it masks the difference between what we know and do not know about something, often conveying a false sense of scientific rigor. And, particularly when it comes to issues such as development and governance, it is extremely important to have a clear distinction between well-substantiated explanations and every other color of hypotheses, assumptions, and guesses. In fact, in any field, it is a minimal requirement for the production of knowledge.

So here’s an interesting exercise. Search on the web for the use of “theory of change” combined with terms like “accountability” and “open government.” Find, for yourself, which ones are really “theories of change” or, rather, merely “hunches of change.”

Most likely, people will keep using theory of change indiscriminately until the next flavor of the moment comes up. In the meantime, beware.

***

Also read: Open Government, Feedback Loops and Semantic Extravaganza