I have been doing some research on works related to the evaluation of citizen engagement initiatives (technology mediated or not). This is far from exhaustive, but I thought it would be worth sharing with those who stop by here. Also, any help with identifying other relevant sources that I may be missing would be greatly appreciated.
- Abelson, J., & Gauvin, F. P. (2006). Assessing the impacts of public participation: Concepts, evidence and policy implications. Ottawa: Canadian Policy Research Networks.
- Abelson, J., Forest, P. G., Eyles, J., Smith, P., Martin, E., & Gauvin, F. P. (2003). Deliberations about deliberative methods: issues in the design and evaluation of public participation processes. Social science & medicine, 57(2), 239-251.
- Aichholzer, G., & Westholm, H. (2009). Evaluating eParticipation projects: practical examples and outline of an evaluation framework. European Journal of ePractice, 7(3).
- Barnett, A., Dembo D., Verhulst S.G. (2013). Toward Metrics for Re-(Imagining) Governance. GovLab Working Paper.
- Beierle, T. C. (1999). Using social goals to evaluate public participation in environmental decisions. Review of Policy Research, 16(3‐4), 75-103.
- Macintosh, A., & Whyte, A. (2008). Towards an evaluation framework for eParticipation. Transforming Government: People, Process and Policy, 2(1), 16-30.
- Macintosh, A., & Whyte, A. (2006, September). Evaluating how eParticipation changes local democracy. In eGovernment Workshop (Vol. 11).
- Mannarini, T., & Talò, C. (2013). Evaluating public participation: instruments and implications for citizen involvement. Community Development, 44(2), 239-256.
- Motsi, G. (2009, June). Evaluating citizen engagement in policy making. InCanadian Society for Evaluation Conference, Institute on Governance (Vol. 2).
- Nabatchi, T. (2012). A manager’s guide to evaluating citizen participation. Washington, DC: IBM Center for the Business of Government.
- Rowe, G., & Frewer, L. J. (2000). Public participation methods: A framework for evaluation. Science, technology & human values, 25(1), 3-29.
- Rowe, G., & Frewer, L. J. (2004). Evaluating public-participation exercises: a research agenda. Science, Technology & Human Values, 29(4), 512-556.
Thanks for sharing Tiago, much appreciated! I am too in the process of identifying literature evaluating citizen engagement and this list is very helpful. In case any other paper comes up during my research I will let you know.
Another one may be Chess&Purcell, 1999, Public participation and the environment: Do we know what works? Environmental Science & Technology 33(16): 2685
Chess/Purcell 1999 Public participation and the environment: do we know what works? Environmental Science & Technology 33(16): 2685
Black, L., Burkhalter, S., Gastil, J., & Stromer-Galley, J. (2010). Methods for analyzing and measuring group deliberation. In L. Holbert (ed.), Sourcebook of political communication research: Methods, measures, and analytical techniques (pp. 323-345). New York: Routledge.
T. Nabatchi, J. Gastil, M. Weiksner, & M. Leighninger (Eds.) (2012). Democracy in motion: Evaluating the practice and impact of deliberative civic engagement. New York: Oxford University Press.
Also, several methods of evaluation are explained and applied in: Carson, L., Gastil, J., Hartz-Karp, J., & Lubensky, R. (Eds.), The Australian Citizens’ Parliament and the future of deliberative democracy. University Park: Pennsylvania State University Press.
Will you publish the results of your research?
Tiago, this new paper may also be relevant: Internet and Policy: making of an Index of Political E-participation and Influence in the Public Policy (IPEIPP) Dr. Claudio Penteado, Mr. Marcelo dos Santos, Dr. Rafael Araújo: paper to be presented at IPSA 2014, 24 July 2014 http://rc10.ipsa.org/post/2014/04/13/IPSA-Montreal-2014-RC-10-Electronic-democracy-Program2
Thanks a lot Simon and Robert. I will go over them in the weekend and add them to the updated list.
@Jorge: we are doing some work on this with other external partners and we should have something by the end of this year. Rest assured we will post about it here.
Here my contribution:
Bertot, John Carlo, Patrice McDermott, and Ted Smith. “Measurement of open government: Metrics and Process.” In System Science (HICSS), 2012 45th Hawaii International Conference on, pp. 2491-2499. IEEE, 2012.
Chadwick, Andrew. “Explaining the failure of an online citizen engagement initiative: The role of internal institutional variables.” Journal of Information Technology & Politics 8, no. 1 (2011): 21-40.
Hevia, Felipe J., Vergara-Lope, Samana. “¿Cómo Medir la Participación? Creación, Validación y Aplicación del Cuestionario Conductas de Participación”. CIESAS. 2011. http://www.scribd.com/doc/95070485/Hevia-y-Vergara-Lope-2012-como-medir-la-participacion
Lukensmeyer, Carolyn J., Joe Goldman, and David Stern. “Assessing public participation in an open government era.” IBM Center for the Business of Government (2011).
Rosener, Judy B. “Citizen participation: can we measure its effectiveness?.” Public Administration Review (1978): 457-463.a
I would offer a couple studies that the National Democratic Institute (NDI) has produced. The first is titled “Political-Process Monitoring: Considering the Outcomes and How they can be Measured” and it can be found here — https://www.ndi.org/political-process-monitoring-outcomes
The second is a forthcoming study simply titled “Citizen Participation and Technology” that will be available on the NDI website in e-book format later this week. Both are qualitative studies of NDI citizen participation programming that try to deepen our institutional understanding of what works and why.
Great resources, big thank you to Tiago and all other contributors!
I recently ran into this blogpost and I cannot thank you enough. I work for a think tank in Colombia which is setting up an observation structure of civic engament processes in the framework of local peacebuilding efforts. We are currently at the stage of defining our indicators and evaluation methodologies so these references definetly come in handy.
Tiago thank you so much for these references. I work for a Think Tank in Colombia which is now working on setting up an observation structure to acompany and evaluate public participation processes in the context of local peace building efforts. This blogpost definetly comes in handy right now as we are beginning to define our indicators and evaluation methodologies.
Hi Laura, I’m happy that is helpful. Out of curiosity, what is the think tank?
Tiago the think tank is Fundación Ideas para la Paz (FIP). Our website is http://www.ideaspaz.org