Tag Archives for crowdsourcing

The haves and the have-nots: who benefits from civic tech?

Photo by Lewis Nguyen on Unsplash

“Civic tech” broadly refers to the use of digital technologies to support a range of citizen engagement processes. From allowing individuals to report problems to local government to enabling the crowdsourcing of national legislation, civic tech aims to promote better policies and services  – while contributing to more inclusive democratic institutions. But could civic tech affect public issues in a way that benefits some and excludes others?

Over the decades, the question of who participates in and who is excluded from participation mediated by technology has been the focus of both civic tech critics and proponents. The latter tend to argue that, by enabling citizens to participate without constraints of time and distance, civic tech facilitates the participation of those who usually abstain from engaging with public issues, leading to more inclusive processes. Critics argue that, given the existing digital divide, unequal access to technology will tend to empower the already empowered, further deepening societal differences. Yet both critics and proponents do tend to share an intuitive assumption: the socio-economic profile of who participates is the primary determinant of who benefits from digitally mediated civic participation. For instance, if more men participate, outcomes will favor male preferences, and if more young people participate, outcomes will be more aligned with the concerns of the youth.

In a new paper, we show that the link between the demographics of those participating through digital channels, and the beneficiaries of the participation process, is not necessarily as straightforward as commonly assumed. We review four civic tech cases where data allow us to trace the full participatory chain through:

  1. the initial digital divide
  2. the participant’s demographics
  3. the demands made through the process
  4. the policy outcomes

We examine online voting in the Brazilian state of Rio Grande do Sul’s participatory budgeting process, the local problem reporting platform Fix My Street (FMS) in the United Kingdom, Iceland’s online crowdsourced constitution process, and the global petitioning platform Change.org.

Counterintuitive findings

Change.org has been used by nearly half a billion people around the globe. Using a dataset of 3.9 million signers of online petitions in 132 countries, we examine the number of successful petitions and assess whether petitions created by women have more success than those submitted by men. Our analysis shows that, even if women create fewer online petitions than men, their petitions are more likely to be successful. All else equal, when online petitions have an impact on government policy, the agenda being implemented is much closer to the issues women choose to focus on.

In Rio Grande do Sul’s digital participatory budgeting (PB), we show that despite important demographic differences between online and offline voters, these inequalities do not affect which types of projects are selected for funding – a consequence of PB’s unique institutional design, which favors redistributive effects. 

In fact, of all the cases analyzed, none reflect the standard assumption that inequalities in who participates translate directly into inequalities in who benefits from the policy outcomes. Our results suggest that the socio-economic profile of participants predicts only in part who benefits from civic tech. Just as important to policy outcomes is how the platform translates civic participation into policy demands, and how the government responds to those demands. While civic tech practitioners pay a lot of attention to design from a technological perspective, our findings highlight the importance of considering how civic tech platforms function as political institutions that encourage certain types of behavior while discouraging others.

Civic tech, it seems, is not inherently good nor bad for democratic institutions. Instead, its effect is a combination of who participates on digital platforms and the choices of platform designers and governments.

***

Post co-authored with Jonathan Mellon and Fredrik M. Sjoberg. Cross-posted from the World Bank’s Let’s Talk Development blog.

Three New Papers (and a presentation) on Civic Tech

CaptureFMS

This blog has been slow lately, but as I mentioned before, it is for a good cause. With some great colleagues I’ve been working on a series of papers (and a book) on civic technology. The first three of these papers are out. There is much more to come, but in the meantime, you can find below the abstracts and link to each of the papers. I also add the link to a presentation which highlights some other issues that we are looking at.

  • Effects of the Internet on Participation: Study of a Public Policy Referendum in Brazil.

Does online voting mobilize citizens who otherwise would not participate? During the annual participatory budgeting vote in the southern state of Rio Grande do Sul in Brazil – the world’s largest – Internet voters were asked whether they would have participated had there not been an online voting option (i-voting). The study documents an 8.2 percent increase in total turnout with the introduction of i-voting. In support of the mobilization hypothesis, unique survey data show that i-voting is mainly used by new participants rather than just for convenience by those who were already mobilized. The study also finds that age, gender, income, education, and social media usage are significant predictors of being online-only voters. Technology appears more likely to engage people who are younger, male, of higher income and educational attainment, and more frequent social media users.

Read more here.

  • The Effect of Government Responsiveness on Future Political Participation.

What effect does government responsiveness have on political participation? Since the 1940s political scientists have used attitudinal measures of perceived efficacy to explain participation. More recent work has focused on underlying genetic factors that condition citizen engagement. We develop a ‘Calculus of Participation’ that incorporates objective efficacy – the extent to which an individual’s participation actually has an impact – and test the model against behavioral data from FixMyStreet.com (n=399,364). We find that a successful first experience using FixMyStreet.com (e.g. reporting a pothole and having it fixed) is associated with a 54 percent increase in the probability of an individual submitting a second report. We also show that the experience of government responsiveness to the first report submitted has predictive power over all future report submissions. The findings highlight the importance of government responsiveness for fostering an active citizenry, while demonstrating the value of incidentally collected data to examine participatory behavior at the individual level.

Read more here.

  • Do Mobile Phone Surveys Work in Poor Countries? 

In this project, we analyzed whether mobile phone-based surveys are a feasible and cost-effective approach for gathering statistically representative information in four low-income countries (Afghanistan, Ethiopia, Mozambique, and Zimbabwe). Specifically, we focused on three primary research questions. First, can the mobile phone survey platform reach a nationally representative sample? Second, to what extent does linguistic fractionalization affect the ability to produce a representative sample? Third, how effectively does monetary compensation impact survey completion patterns? We find that samples from countries with higher mobile penetration rates more closely resembled the actual population. After weighting on demographic variables, sample imprecision was a challenge in the two lower feasibility countries (Ethiopia and Mozambique) with a sampling error of /- 5 to 7 percent, while Zimbabwe’s estimates were more precise (sampling error of /- 2.8 percent). Surveys performed reasonably well in reaching poor demographics, especially in Afghanistan and Zimbabwe. Rural women were consistently under-represented in the country samples, especially in Afghanistan and Ethiopia. Countries’ linguistic fractionalization may influence the ability to obtain nationally representative samples, although a material effect was difficult to discern through penetration rates and market composition. Although the experimentation design of the incentive compensation plan was compromised in Ethiopia and Zimbabwe, it seems that offering compensation for survey completion mitigated attrition rates in several of the pilot countries while not reducing overall costs. These effects varied across countries and cultural settings.

Read more here.

  • The haves and the have nots: is civic tech impacting the people who need it most? (presentation) 

Read more here.

Over 40 Papers on Crowdsourcing for Politics & Policy

pic by James Cridland (flickr)

Today saw the beginning of the biennial conference on Internet, Politics and Policy, convened by the Oxford Internet Institute (University of Oxford) and OII-edited academic journal Policy and Internet. This year’s conference theme is Crowdsourcing for Politics and Policy. Skimming over some papers and abstracts,  here are some of my first (and rather superficial) impressions:

  • Despite the focus of the conference, there are few papers looking at an essential issue of crowdsourcing, namely its potential epistemic attributes. That is, when, why and how “the many are smarter than the few” and the role that technology plays in this.
  • In methodological terms, it seems that very little of the research presented takes advantage of the potential offered by ICT mediated processes when it comes to i) quantitative work with “administrative” data and ii) experimental research design.
  • On the issue of deliberation, it is good to see that more people are starting to look at design issues, slowly moving away from the traditional fixation on the Habermasian ideal (I’ve talked about this in a presentation here).
  • It seems that the majority of the papers focus on European experiences or those from other developed countries. At first, this is not surprising given the location of the conference and the resources that researchers from these countries have (e.g. travel budget). Yet, it may also suggest limited integration between North/South networks of researchers.

With regard to the last point above, it appears that there is a bridge yet to be built between the community of researchers represented by those attending this conference and the emerging community from the tech4accountability space. There’s lots of potential gain for both sides in engaging in a dialogue and, as importantly, a common language. The “Internet & Politics” community would benefit from the tech4accountability’s focus – although sometimes fuzzy – on development outcomes and experiences that emerge from the “South”. Conversely, the tech4accountability community would benefit a great deal by connecting with the existing (and clearly more mature) knowledge when it comes to the intersection of ICT, politics and citizen engagement.

Needless to say, all of the above are initial impressions and broad generalizations, and as such, may be unfair. The OII biennial conference remains, without a doubt, one of the major conferences in its field. You can view the full program of the conference here. I have also listed below in a simplified manner the links to the available papers of the conference according to their respective tracks.

Track A: Harnessing the Crowd

Experiments on Crowdsourcing Policy Assessmen

A Case Study in Modelling Government-Citizen Interaction in Facebook

Mapping the common based peer production: A crowd-sourcing experiment

Comparing Three Online Civic Engagement Platforms using the “Spectrum of Public Participation” Framework

Crowdfunding guidance and practice: Value added co-creation

The potential of Participedia as a crowdsourcing tool for comparative analysis of democratic innovations

Crowd Capital in Governance Contexts

Analyzing Crowd Discussion Towards a more complete model to measure and explain online deliberation

Predicting Events Using Learning Algorithms on Micro Blog Data

A Crowdsourcing Approach to Identify Common Method Bias and Self-Representation

Hate Speech, Machine Classification and Statistical Modelling of Information Flows on Twitter

Internet-mediated cooperative norm setting in the university

Monopsony and the Crowd: Labor for Lemons?

Online labour markets – leveling the playing field for international service markets?

TRACK B: Policy and Government

Crowdsourcing measurement of e-government usability
A Framework for Policy Crowdsourcing

The Neo-Humanitarians: Assessing the Credibility of Organized Volunteer Crisis Mappers

Let The Users Be The Filter? Crowdsourced Filtering To Avoid Online Intermediary Liability

Regulating Distributed Peer-Production Infrastructures

Population as Auditor of an Election Process in Honduras: VotoSocial

Crowd-sourcing corruption: some challenges, some possible futures

Vertical crowdsourcing: The discourses of activity and the governance of crowds in emergency situations

TRACK C: Engaging the Crowd

What does crowdsourcing legislation entail for the participants? The Finnish case of Avoin Ministeriö

Let the crowd decide? Crowdsourcing ideas as an emerging form of multistakeholder participation

The question of technologically mediated civic political participation reformulated

Discussing Germany’s Future: The Evaluation of Federal Online Citizen Participation

Reprogramming power through crowdsourcing: time, space and citizenship in crowdsourcing for law in Finland

Crowdsourcing as Reflective Political Practice: Building a Location-based Tool for Civic Learning and Engagement

Civic crowdfunding as a marketplace for participation in urban development

Voices in the Noise: Crowdsourcing Public Opinion using Urban Pervasive Technologies

Crowdsourcing and Crowdfunding Mechanisms for Scientific Research Funding Agencies – A Preliminary Entity Categorisation Matrix
Citizen science and Crowd science in biodiversity research
Is Crowdsourcing a Model for Cultural Institutions? The Case of a Polish GLAM Project

TRACK D: Networked Politics

Open Societal Innovation (OSI) for Politics, Public Administration, and Civil Society

The EU Parliament on Twitter – Assessing the Permanent Online Practices of Parliamentarians

Crowdsourcing & Crowdfunding a Presidential Campaign

Politically Polarized Online Groups and their Social Structures formed around the 2013-2014 crisis in Ukraine

Network polarization in online politics participatory media

Impact of digital social networks on health and health systems

Mapping online political talks through network analysis: A case study of the website of Italy’s Five Star Movement

The Logic of Communitive Action: A Case Study of Taiwan’s Sunflower Movement

How UK local government actors reacted to 2013 central spending decisions: the #localgov Twitter community

Crowdsourcing Off-Road Traffic Legislation in Finland

Screen Shot 2013-07-21 at 10.37.34 AM

A paper by Tanja Aitamurto (Tampere) and Hélène Landemore (Stanford) on an interesting crowdsourcing exercise in Finland.

Abstract

This paper reports on a pioneering case study of a legislative process open to the direct online participation of the public. The empirical context of the study is a crowdsourced off-road traffic law in Finland. On the basis of our analysis of the user content generated to date and a series of interviews with key participants, we argue that the process qualifies as a promising case of deliberation on a mass-scale. This case study will make an important contribution to the understanding of online methods for participatory and deliberative democracy. The preliminary findings indicate that there is deliberation in the crowdsourcing process, which occurs organically (to a certain degree) among the participants, despite the lack of incentives for it. Second, the findings strongly indicate that there is a strong educative element in crowdsourced lawmaking process, as the participants share information and learn from each other. The peer-learning aspect could be made even stronger through the addition of design elements in the process and on the crowdsourcing software.

The first two things that come to mind when reading this, are:

  1. If there is a “strong educative element” in the crowdsourcing process, we have an argument for large-scale citizen participation. The more citizens take part in a process, the more citizens benefit from the educative element.
  2. If we consider point 1 to be true, there is still a major technical challenge in terms of having appropriate platforms to enable large-scale deliberative processes. For instance, I have some reservations about crowdsourcing efforts that use ideation systems like Ideascale (as is the case for this experience). In my opinion such systems are prone to information cascades and a series of other biases that compromise an exercise in terms of a) deliberative quality and b) final outcomes (i.e. quality of ideas).

There’s still lots to learn on that front, and there is a dire need for more research of this type. Kudos should also go to the proponents of the initiative, who involved the authors in the project from the start.

Read the full paper here [PDF].