Underestimated effects of AI on democracy, and a gloomy scenario

A few years ago, Tom Steinberg and I discussed the potential risks posed by AI bots in influencing citizen engagement processes and manipulating public consultations. With the rapid advancement of AI technology, these risks have only intensified. This escalating concern has even elicited an official response from the White House.

A recent executive order has tasked the Office of Information and Regulatory Affairs (OIRA) at the White House with considering the implementation of guidance or tools to address mass comments, computer-generated remarks, and falsely attributed comments. This directive comes in response to growing concerns about the impact of AI on the regulatory process, including the potential for generative chatbots to lead mass campaigns or flood the federal agency rule-making process with spam comments.

The threat of manipulation becomes even more pronounced when content generated by bots is viewed by policymakers as being on par with human-created content. There’s evidence to suggest that this may be already occurring in certain scenarios. For example, a recent experiment was designed to measure the impact of language models on effective communication with members of Congress. The goal was to determine if these models could divert legislative attention by generating a constant stream of unique emails directed at congressional members. Both human writers and GPT-3 were employed in the study. Emails were randomly sent to over 7,000 state representatives throughout the country, after which response rates were compared. The results showed a mere 2% difference in response rates, and for some of the policy topics studied, the response rates remained consistent.

Now, the real trouble begins when governments jump on the bot bandwagon and start using their own bots to respond, and we, the humans, are left out of the conversation entirely. It’s like being the third wheel on a digital date that we didn’t even know was happening. That’s a gloomy scenario.

2020 and beyond: 11 predictions at the intersection of technology and citizen engagement

pic by @jmuniz on Unsplah

The rapid evolution of digital technologies has been changing relationships between governments and citizens around the world.  These shifts make it the right time to pose the key question a new World Bank publication explores: 

Will digital technologies, both those that are already widespread and those that are still emerging, have substantial impacts on the way citizens engage and the ways in which power is sought, used, or contested?

The report, Emerging Digital Technologies and Citizen Participation, benefits from the insights of 30 leading scholars and practitioners, and explores what technology might mean for citizen engagement and politics in the coming years. 

The report argues that, regardless of lower technology penetration levels, and given more malleable governance contexts, developing countries may be more influenced by the effects of emerging technologies than older states with greater rigidity and legacy technologies. Digitally influenced citizen engagement is potentially a “leapfrog” area in which developing nations may exploit emerging technologies before the wealthier parts of the world.  

But countries can leapfrog to worse futures, not only better ones. The report also conveys concerns about the negative effects digital technologies can have on the governance of nations. Yet, despite emerging challenges, it contends that new and better citizen engagement approaches are possible. 

What is missing from public discourse is a discussion of the wide range of options that citizens and decision-makers can call upon to enhance their interactions and manage risks. To consider these options, the report makes 11 predictions regarding the effects of technology on citizen engagement in the coming years, and their policy implications. It also offers six measures that would be prudent for governments to take to mitigate risks and leverage opportunities that technological development brings about. 

None of the positive scenarios predicted will emerge without deliberate and intentional actions to support them. And the extent to which they can be shaped to further societal goals will depend on constructive dialogue between governments and citizens themselves. Ultimately, this new publication aims to contribute to this dialogue, so that both developing and developed countries are more likely to leap into better futures. 

*************

Text co-authored with Tom Steinberg, originally cross-posted from the World Bank’s Governance for Development blog. You can also read another article about this report in Apolitical here. While I’m at it: if you work in public service and care about making government work better, I highly recommend Apolitical, a peer-to-peer learning platform for government, sharing smart ideas in policy globally. Join for free here .