A Systematic Review and Thematic Analysis of Community-Collaborative Approaches to Computing Research

ABSTRACT

HCI researchers have been gradually shifting attention from individual users to communities when engaging in research, design, and system development. However, our field has yet to establish a cohesive, systematic understanding of the challenges, benefits, and commitments of community-collaborative approaches to research. We conducted a systematic review and thematic analysis of 47 computing research papers discussing participatory research with communities for the development of technological artifacts and systems, published over the last two decades. From this review, we identified seven themes associated with the evolution of a project: from establishing community partnerships to sustaining results. Our findings suggest that several tensions characterize these projects, many of which relate to the power and position of researchers, and the computing research environment, relative to community partners. We discuss the implications of our findings and offer methodological proposals to guide HCI, and computing research more broadly, towards practices that center communities.

References

1. Clem Adelman. 1993. Kurt Lewin and the Origins of Action Research. Educational Action Research 1, 1 (1993), 7–24. https://doi.org/10.1080/0965079930010102 arXiv:https://doi.org/10.1080/0965079930010102
2. Alex A Ahmed, Bryan Kok, Coranna Howard, and Klew Still. 2021. Online Community-Based Design of Free and Open Source Software for Transgender Voice Training. Proc. ACM Hum.-Comput. Interact. 4, CSCW3, Article 258 (Jan. 2021), 27 pages. https://doi.org/10.1145/3434167
3. Antwi Akom, Aekta Shah, Aaron Nakai, and Tessa Cruz. 2016. Youth Participatory Action Research (YPAR) 2.0: How Technological Innovation and Digital Organizing Sparked a Food Revolution in East Oakland. International Journal of Qualitative Studies in Education 29, 10(2016), 1287–1307. https://doi.org/10.1080/09518398.2016.1201609
4. Paul Aoki, Allison Woodruff, Baladitya Yellapragada, and Wesley Willett. 2017. Environmental Protection and Agency: Motivations, Capacity, and Goals in Participatory Sensing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 3138–3150.
5. Peter M Asaro. 2000. Transforming Society by Transforming Technology: The Science and Politics of Participatory Design. Accounting, Management and Information Technologies 10, 4(2000), 257–290.
6. David E. Avison, Francis Lau, Michael D. Myers, and Peter Axel Nielsen. 1999. Action Research. Commun. ACM 42, 1 (Jan. 1999), 94–97. https://doi.org/10.1145/291469.291479
7. Foster Osei Baah, Anne M. Teitelman, and Barbara Riegel. 2019. Marginalization: Conceptualizing Patient Vulnerabilities in the Framework of Social Determinants of Health—An Integrative Review. Nursing Inquiry 26, 1 (2019), e12268. https://doi.org/10.1111/nin.12268
8. Mark S. Baldwin, Sen H. Hirano, Jennifer Mankoff, and Gillian R. Hayes. 2019. Design in the Public Square: Supporting Assistive Technology Design through Public Mixed-Ability Cooperation. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 155 (Nov. 2019), 22 pages. https://doi.org/10.1145/3359257
9. Fran Baum, Colin MacDougall, and Danielle Smith. 2006. Participatory Action Research. Journal of Epidemiology and Community Health 60, 10 (2006), 854.
10. Simon Bell, Stephen Morse, and Rupesh A. Shah. 2012. Understanding Stakeholder Participation in Research as Part of Sustainable Development. Journal of Environmental Management 101 (2012), 13–22. https://doi.org/10.1016/j.jenvman.2012.02.004
11. Erling Björgvinsson, Pelle Ehn, and Per-Anders Hillgren. 2010. Participatory Design and “Democratizing Innovation”. In Proceedings of the 11th Biennial Participatory Design Conference(PDC ’10). Association for Computing Machinery, New York, NY, USA, 41–50. https://doi.org/10.1145/1900441.1900448
12. Alan F Blackwell. 2015. HCI as an Inter-Discipline. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems(CHI EA ’15). Association for Computing Machinery, New York, NY, USA, 503–516. https://doi.org/10.1145/2702613.2732505
13. Edwin Blake, Uariaike Mbinge, Heike Winschiers-Theophilus, Donovan Maasz, Colin Stanley, Chris Paul Muashekele, and Gereon Koch Kapuire. 2021. Going beyond Empowered Design by Scaffolding Inter-Community Engagement. In C&T ’21: Proceedings of the 10th International Conference on Communities & Technologies - Wicked Problems in the Age of Tech. Association for Computing Machinery, New York, NY, USA, 224–233.
14. Jeanette L. Blomberg and Austin Henderson. 1990. Reflections on Participatory Design: Lessons from the Trillium Experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’90). Association for Computing Machinery, New York, NY, USA, 353–360. https://doi.org/10.1145/97243.97307
15. Susanne Bødker and Morten Kyng. 2018. Participatory Design That Matters—Facing the Big Issues. ACM Transactions on Computer-Human Interaction 25, 1, Article 4 (Feb. 2018), 31 pages. https://doi.org/10.1145/3152421
16. Margaret R Boyd. 2014. Community-Based Research. In The Oxford Handbook of Qualitative Research, Patricia Leavy (Ed.). Oxford University Press, New York, NY, USA, 484–517.
17. Stein Braten. 1973. Model Monopoly and Communication: Systems Theoretical Notes on Democratization. Acta Sociologica 16, 2 (1973), 98–107.
18. Virginia Braun and Victoria Clarke. 2006. Using Thematic Analysis in Psychology. Qualitative Research in Psychology 3, 2 (Jan. 2006), 77–101.
19. Virginia Braun and Victoria Clarke. 2020. One Size Fits All? What Counts as Quality Practice in (Reflexive) Thematic Analysis?Qualitative Research in Psychology 18, 3 (Aug. 2020), 1–25.
20. Anna Brown, Alexandra Chouldechova, Emily Putnam-Hornstein, Andrew Tobin, and Rhema Vaithianathan. 2019. Toward Algorithmic Accountability in Public Services: A Qualitative Study of Affected Community Perspectives on Algorithmic Decision-Making in Child Welfare Services. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12.
21. David Byrne. 2021. A Worked Example of Braun and Clarke’s Approach to Reflexive Thematic Analysis. Quality & Quantity (June 2021), 1–22. https://doi.org/10.1007/s11135-021-01182-y
22. Ana Caraban, Evangelos Karapanos, Daniel Gonçalves, and Pedro Campos. 2019. 23 Ways to Nudge: A Review of Technology-Mediated Nudging in Human-Computer Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–15.
23. Peggy G. Chen, Nitza Diaz, Georgina Lucas, and Marjorie S. Rosenthal. 2010. Dissemination of Results in Community-Based Participatory Research. American Journal of Preventive Medicine 39, 4 (2010), 372–378. https://doi.org/10.1016/j.amepre.2010.05.021
24. Patricia A L Cochran, Catherine A Marshall, Carmen Garcia-Downing, Elizabeth Kendall, Doris Cook, Laurie McCubbin, and Reva Mariah S Gover. 2008. Indigenous Ways of Knowing: Implications for Participatory Research and Community. American Journal of Public Health 98, 1 (Jan. 2008), 22–27. https://doi.org/10.2105/AJPH.2006.093641
25. Sasha Costanza-Chock. 2020. Design Justice: Community-led Practices to Build the Worlds We Need. The MIT Press, Cambridge, MA, USA.
26. Francine E. Darroch and Audrey R. Giles. 2017. Conception of a Resource: Development of a Physical Activity and Healthy Living Resource with and for Pregnant Urban First Nations and Métis Women in Ottawa, Canada. Qualitative Research in Sport, Exercise and Health 9, 2 (2017), 157–169. https://doi.org/10.1080/2159676X.2016.1246471
27. Rogério DePaula. 2004. Lost in Translation: A Critical Analysis of Actors, Artifacts, Agendas, and Arenas in Participatory Design. In Proceedings of the Eighth Conference on Participatory Design: Artful Integration: Interweaving Media, Materials and Practices-Volume 1. Association for Computing Machinery, New York, NY, USA, 162–172.
28. Jessa Dickinson, Jalon Arthur, Maddie Shiparski, Angalia Bianca, Alejandra Gonzalez, and Sheena Erete. 2021. Amplifying Community-Led Violence Prevention as a Counter to Structural Oppression. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 180 (April 2021), 28 pages. https://doi.org/10.1145/3449279
29. Carl DiSalvo. 2011. Community and Conflict. Interactions 18, 6 (Nov. 2011), 24–26. https://doi.org/10.1145/2029976.2029984
30. Carl DiSalvo, Andrew Clement, and Volkmar Pipek. 2013. Communities: Participatory Design for, with and by Communities. In Routledge International Handbook of Participatory Design, Jesper Simonsenand Toni Robertson (Eds.). Taylor & Francis Group, London, UK.
31. Carl DiSalvo, Marti Louw, David Holstius, Illah Nourbakhsh, and Ayça Akin. 2012. Toward a Public Rhetoric Through Participatory Design: Critical Engagements and Creative Expression in the Neighborhood Networks Project. Design Issues 28, 3 (July 2012), 48–61. https://doi.org/10.1162/DESI_a_00161
32. Lynn Dombrowski, Ellie Harmon, and Sarah Fox. 2016. Social Justice-Oriented Interaction Design: Outlining Key Design Strategies and Commitments. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems. Association for Computing Machinery, New York, NY, USA, 656–671.
33. Joseph Donia and Jay Shaw. 2021. Co-Design and Ethical Artificial Intelligence for Health: Myths and Misconceptions. In Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society(AIES ’21). Association for Computing Machinery, New York, NY, USA, 77.
34. Paul Dourish, Christopher Lawrence, Tuck Wah Leong, and Greg Wadley. 2020. On Being Iterated: The Affective Demands of Design Participation. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems(CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3313831.3376545
35. Ana Maria Bustamante Duarte, Nina Brendel, Auriol Degbelo, and Christian Kray. 2018. Participatory Design and Participatory Research: An HCI Case Study with Young Forced Migrants. ACM Transactions on Computer-Human Interaction 25, 1, Article 3 (Feb. 2018), 39 pages. https://doi.org/10.1145/3145472
36. Marisa Elena Duarte, Morgan Vigil-Hayes, Ellen Zegura, Elizabeth Belding, Ivone Masara, and Jennifer Case Nevarez. 2021. As a Squash Plant Grows: Social Textures of Sparse Internet Connectivity in Rural and Tribal Communities. ACM Transactions on Computer-Human Interaction 28, 3 (July 2021), 1–16. https://doi.org/10.1145/3453862
37. Sheena Erete, Aarti Israni, and Tawanna Dillahunt. 2018. An Intersectional Approach to Designing in the Margins. Interactions 25, 3 (April 2018), 66–69. https://doi.org/10.1145/3194349
38. Marie Ertner, Anne Mie Kragelund, and Lone Malmborg. 2010. Five Enunciations of Empowerment in Participatory Design. In Proceedings of the 11th Biennial Participatory Design Conference. Association for Computing Machinery, New York, NY, USA, 191–194.
39. EURORDIS. 2020. Community Advisory Board (CAB) Programme. https://www.eurordis.org/content/eurordis-community-advisory-board-cab-programme.
40. Ronald A Feldman and John S Wodarski. 1974. Bureaucratic Constraints and Methodological Adaptations in Community-Based Research. American Journal of Community Psychology 2, 2 (1974), 211.
41. National Science Foundation. 2021. Smart and Connected Communities (S&CC). https://beta.nsf.gov/funding/opportunities/smart-and-connected-communities-scc.
42. Sarah Fox, Jill Dimond, Lilly Irani, Tad Hirsch, Michael Muller, and Shaowen Bardzell. 2017. Social Justice and Design: Power and Oppression in Collaborative Systems. In Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing(CSCW ’17 Companion). Association for Computing Machinery, New York, NY, USA, 117–122. https://doi.org/10.1145/3022198.3022201
43. Sarah Fox and Christopher Le Dantec. 2014. Community Historians: Scaffolding Community Engagement through Culture and Heritage. In Proceedings of the 2014 Conference on Designing Interactive Systems(DIS ’14). Association for Computing Machinery, New York, NY, USA, 785–794. https://doi.org/10.1145/2598510.2598563
44. Christopher Frauenberger, Judith Good, Geraldine Fitzpatrick, and Ole Sejer Iversen. 2015. In Pursuit of Rigour and Accountability in Participatory Design. International Journal of Human-Computer Studies 74 (2015), 93–106. https://doi.org/10.1016/j.ijhcs.2014.09.004
45. Joel Fredericks, Glenda Amayo Caldwell, and Martin Tomitsch. 2016. Middle-out Design: Collaborative Community Engagement in Urban HCI. In Proceedings of the 28th Australian Conference on Computer-Human Interaction. Association for Computing Machinery, New York, NY, USA, 200–204.
46. Wendy Frisby, Susan Crawford, and Therese Dorer. 1997. Reflections on Participatory Action Research: The Case of Low-Income Women Accessing Local Physical Activity Services. Journal of Sport Management 11, 1 (1997), 8–28.
47. Tamar Ginossar and Sara Nelson. 2010. Reducing the Health and Digital Divides: A Model for Using Community-Based Participatory Research Approach to E-Health Interventions in Low-Income Hispanic Communities. Journal of Computer-Mediated Communication 15, 4 (July 2010), 530–551. https://doi.org/10.1111/j.1083-6101.2009.01513.x
48. Jeffrey T. Grabill. 2003. Community Computing and Citizen Productivity. Computers and Composition 20, 2 (2003), 131–150. https://doi.org/10.1016/S8755-4615(03)00015-X
49. Jill Grant, Geoffrey Nelson, and Terry Mitchell. 2008. Negotiating the Challenges of Participatory Action Research: Relationships, Power, Participation, Change and Credibility. In Handbook of Action Research. SAGE Publications, Thousand Oaks, California, 589–607.
50. Robert L Green and Lawrence W Lezotte. 1973. Unresolved Issues in Community-Based Research. Journal of Non-White Concerns in Personnel and Guidance 1, 3(1973), 124–132.
51. Hélène Grégoire and June Ying Yee. 2007. Ethics in Community-University Partnerships Involving Racial Minorities: An Anti-Racism Standpoint in Community-Based Participatory Research. Partnership Perspectives 4, 1 (2007), 70–77.
52. Florian Grond, M. Ariel Cascio, Rossio Motta-Ochoa, Tamar Tembeck, Dan Ten Veen, and Stefanie Blain-Moraes. 2019. Participatory Design of Biomusic with Users on the Autism Spectrum. In 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1109/ACII.2019.8925484
53. Oliver L. Haimson, Dykee Gorrell, Denny L. Starks, and Zu Weinger. 2020. Designing Trans Technology: Defining Challenges and Envisioning Community-Centered Solutions. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13.
54. Aaron Halfaker and R. Stuart Geiger. 2020. ORES: Lowering Barriers with Participatory Machine Learning in Wikipedia. Proc. ACM Hum.-Comput. Interact. 4, CSCW2, Article 148 (Oct. 2020), 37 pages. https://doi.org/10.1145/3415219
55. Lon Åke Erni Johannes Hansson, Teresa Cerratto Pargman, and Daniel Sapiens Pargman. 2021. A Decade of Sustainable HCI: Connecting SHCI to the Sustainable Development Goals. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA.
56. Christina Harrington and Tawanna R Dillahunt. 2021. Eliciting Tech Futures among Black Young Adults: A Case Study of Remote Speculative Co-Design. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–15.
57. Christina Harrington, Sheena Erete, and Anne Marie Piper. 2019. Deconstructing Community-Based Collaborative Design: Towards More Equitable Participatory Design Engagements. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 216 (Nov. 2019), 25 pages. https://doi.org/10.1145/3359318
58. Christina N. Harrington, Katya Borgos-Rodriguez, and Anne Marie Piper. 2019. Engaging Low-Income African American Older Adults in Health Discussions through Community-Based Design Workshops. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–15.
59. Alexa M. Harris, Diego Gómez-Zará, Leslie A. DeChurch, and Noshir S. Contractor. 2019. Joining Together Online: The Trajectory of CSCW Scholarship on Group Formation. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 148 (Nov. 2019), 27 pages. https://doi.org/10.1145/3359250
60. Gillian R. Hayes. 2011. The Relationship of Action Research to Human-Computer Interaction. ACM Transactions on Computer-Human Interaction 18, 3, Article 15 (Aug. 2011), 20 pages. https://doi.org/10.1145/1993060.1993065
61. Kai Holländer, Mark Colley, Enrico Rukzio, and Andreas Butz. 2021. A Taxonomy of Vulnerable Road Users for HCI Based on a Systematic Literature Review. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, Article 158, 13 pages.
62. Carol R. Horowitz, Mimsie Robinson, and Sarena Seifer. 2009. Community-Based Participatory Research from the Margin to the Mainstream. Circulation 119, 19 (2009), 2633–2642. https://doi.org/10.1161/CIRCULATIONAHA.107.729863 arXiv:https://www.ahajournals.org/doi/pdf/10.1161/CIRCULATIONAHA.107.729863
63. Peter S Hovmand. 2014. Introduction to Community-Based System Dynamics. In Community Based System Dynamics. Springer New York, New York, NY, 1–16.
64. Yen-Chia Hsu, Paul Dille, Jennifer Cross, Beatrice Dias, Randy Sargent, and Illah Nourbakhsh. 2017. Community-Empowered Air Quality Monitoring System. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1607–1619.
65. Lilly Irani. 2018. “Design Thinking”: Defending Silicon Valley at the Apex of Global Labor Hierarchies. Catalyst 4, 1 (May 2018), 1–19. https://doi.org/10.28968/cftt.v4i1.29638
66. Barbara A Israel, Eugenia Eng, Amy J Schulz, and Edith A Parker (Eds.). 2012. Methods in Community-Based Participatory Research for Health (second ed.). Jossey-Bass, San Francisco, CA, USA.
67. Barbara A Israel, Amy J Schulz, Edith A Parker, and Adam B Becker. 1998. Review of Community-Based Research: Assessing Partnership Approaches to Improve Public Health. Annual Review of Public Health 19 (1998), 173–202.
68. Pertti Järvinen. 1981. The User as a Learning Component in a Data System during the Change-over and Use Periods. In Proceedings of the Eighteenth Annual Computer Personnel Research Conference. Association for Computing Machinery, New York, NY, USA, 39–63.
69. Ben Jelen. 2020. How to Write an HCI Systematic Review. https://wphomes.soic.indiana.edu/bcjelen/2020/04/07/how-to-write-an-hci-systematic-review/.
70. Kasper L. Jensen, Heike Winschiers-Theophilus, Kasper Rodil, Naska Winschiers-Goagoses, Gereon K. Kapuire, and Richard Kamukuenjandje. 2012. Putting It in Perspective: Designing a 3D Visualization to Contextualize Indigenous Knowledge in Rural Namibia. In Proceedings of the Designing Interactive Systems Conference(DIS ’12). Association for Computing Machinery, New York, NY, USA, 196–199. https://doi.org/10.1145/2317956.2317986
71. Jeff Johnson. 1990. Participatory Design of Computer Systems (Panel). In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’90). Association for Computing Machinery, New York, NY, USA, 141–144. https://doi.org/10.1145/97243.97266
72. Gereon Koch Kapuire, Heike Winschiers-Theophilus, and Edwin Blake. 2015. An Insider Perspective on Community Gains: A Subjective Account of a Namibian Rural Communities’ Perception of a Long-Term Participatory Design Project. International Journal of Human–Computer Studies 74, C (Feb. 2015), 124–143.
73. Finn Kensing and Jeanette Blomberg. 1998. Participatory Design: Issues and Concerns. Computer Supported Cooperative Work (CSCW) 7, 3 (Sept. 1998), 167–185. https://doi.org/10.1023/A:1008689307411
74. Pietari Keskinen, Marley Samuel, Helena Afrikaneer, and Heike Winschiers-Theophilus. 2021. A Community-Initiated Website Development Project: Promoting a San Community Campsite Initiative. In 3rd African Human-Computer Interaction Conference: Inclusiveness and Empowerment. Association for Computing Machinery, New York, NY, USA, 1–11.
75. Al Majed Khan, Dr Mark D. Dunlop, Dr Marilyn Lennon, and Dr Mateusz Dubiel. 2021. Towards Designing Mobile Apps for Independent Travel: Exploring Current Barriers and Opportunities for Supporting Young Adults with down’s Syndrome. ACM Transactions on Accessible Computing (TACCESS) 14, 3, Article 13 (July 2021), 40 pages. https://doi.org/10.1145/3460943
76. Reuben Kirkham. 2021. Why Disability Identity Politics in Assistive Technologies Research Is Unethical. In Moving Technology Ethics at the Forefront of Society, Organisations and Governments. Universidad de La Rioja, Logroño, Spain, 475–487.
77. Lila Kossyvaki, Georgios Papadakis, and Sara Curran. 2018. Using Technology-Mediated Music-Making at School with Children with Autism and Intellectual Disabilities: A Participatory Multidisciplinary Approach. In Proceedings of the 8th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-Exclusion(DSAI 2018). Association for Computing Machinery, New York, NY, USA, 152–155. https://doi.org/10.1145/3218585.3218662
78. Rhonda Koster, Kirstine Baccar, and R Harvey Lemelin. 2012. Moving from Research ON, to Research WITH and FOR Indigenous Communities: A Critical Reflection on Community-Based Participatory Research. The Canadian Geographer/Le Géographe Canadien 56, 2 (2012), 195–210.
79. J R Landis and G Koch. 1977. An Application of Hierarchical Kappa-Type Statistics in the Assessment of Majority Agreement among Multiple Observers. Biometrics. Journal of the International Biometric Society 33 2 (1977), 363–374.
80. Christopher A. Le Dantec and Sarah Fox. 2015. Strangers at the Gate: Gaining Access, Building Rapport, and Co-Constructing Community-Based Research. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing(CSCW ’15). Association for Computing Machinery, New York, NY, USA, 1348–1358. https://doi.org/10.1145/2675133.2675147
81. Kurt Lewin. 1946. Action Research and Minority Problems. The Journal of Social Issues 2, 4 (Nov. 1946), 34–46.
82. Calvin A. Liang, Sean A. Munson, and Julie A. Kientz. 2021. Embracing Four Tensions in Human-Computer Interaction Research with Marginalized People. ACM Transactions on Computer-Human Interaction 28, 2, Article 14 (April 2021), 47 pages. https://doi.org/10.1145/3443686
83. L Manda-Taylor. 2013. Establishing Community Advisory Boards for Clinical Trial Research in Malawi: Engendering Ethical Conduct in Research. Malawi Medical Journal 25, 4 (2013), 96–100.
84. Roisin McNaney, John Vines, Andy Dow, Harry Robinson, Heather Robinson, Kate McDonald, Leslie Brown, Peter Santer, Don Murray, Janice Murray, David Green, and Peter Wright. 2018. Enabling the Participation of People with Parkinson’s and Their Caregivers in Co-Inquiry around Collectivist Health Technologies. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–14.
85. Robin McTaggart. 1991. Principles for Participatory Action Research. Adult Education Quarterly 41, 3 (Sept. 1991), 168–187.
86. Bharat Mehra, Ann Peterson Bishop, Imani Bazzell, and Cynthia Smith. 2002. Scenarios in the Afya Project as a Participatory Action Research (PAR) Tool for Studying Information Seeking and Use across the “Digital Divide”. Journal of the American Society for Information Science and Technology 53, 14 (2002), 1259–1266.
87. Meredith Minkler and Nina Wallerstein. 2011. Community-Based Participatory Research for Health: From Process to Outcomes. Jossey-Bass, San Francisco, CA, USA.
88. Sanika Moharana, Alejandro E. Panduro, Hee Rin Lee, and Laurel D. Riek. 2019. Robots for Joy, Robots for Sorrow: Community Based Robot Design for Dementia Caregivers. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). Association for Computing Machinery, New York, NY, USA, 458–467. https://doi.org/10.1109/HRI.2019.8673206
89. Maletsabisa Molapo, Melissa Densmore, and Limpho Morie. 2016. Designing with Community Health Workers: Enabling Productive Participation through Exploration. In Proceedings of the First African Conference on Human Computer Interaction(AfriCHI’16). Association for Computing Machinery, New York, NY, USA, 58–68. https://doi.org/10.1145/2998581.2998589
90. Michael J Muller and Allison Druin. 2012. Participatory Design: The Third Space in Human–Computer Interaction. In The Human–Computer Interaction Handbook. CRC Press, Boca Raton, FL, USA, 1125–1153.
91. Michael J Muller and Sarah Kuhn. 1993. Participatory Design. Commun. ACM 36, 6 (June 1993), 24–28. https://doi.org/10.1145/153571.255960
92. John W Murphy and Joseph J Pilotta. 1984. Community Based Research: A New Strategy for Policy Analysis. Humboldt Journal of Social Relations 11, 2 (1984), 17–27.
93. Isabel Neto, Hugo Nicolau, and Ana Paiva. 2021. Community Based Robot Design for Classrooms with Mixed Visual Abilities Children. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA.
94. Susan D Newman, Jeannette O Andrews, Gayenell S Magwood, Carolyn Jenkins, Melissa J Cox, and Deborah C Williamson. 2011. Community Advisory Boards in Community-Based Participatory Research: A Synthesis of Best Processes. Preventing Chronic Disease 8, 3 (2011), A70.
95. Ihudiya Finda Ogbonnaya-Ogburu, Angela D.R. Smith, Alexandra To, and Kentaro Toyama. 2020. Critical Race Theory for HCI. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–16.
96. Teresa K. O’Leary, Elizabeth Stowell, Everlyne Kimani, Dhaval Parmar, Stefan Olafsson, Jessica Hoffman, Andrea G. Parker, Michael K. Paasche-Orlow, and Timothy Bickmore. 2020. Community-Based Cultural Tailoring of Virtual Agents. In Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents(IVA ’20). Association for Computing Machinery, New York, NY, USA, Article 43, 8 pages. https://doi.org/10.1145/3383652.3423875
97. Christina M Pacheco, Sean M Daley, Travis Brown, Melissa Filippi, K Allen Greiner, and Christine M Daley. 2013. Moving Forward: Breaking the Cycle of Mistrust between American Indians and Researchers. American journal of public health 103, 12 (Dec. 2013), 2152–2159. https://doi.org/10.2105/AJPH.2013.301480
98. Andrea Parker, Vasudhara Kantroo, Hee Rin Lee, Miguel Osornio, Mansi Sharma, and Rebecca Grinter. 2012. Health Promotion as Activism: Building Community Capacity to Effect Social Change. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 99–108.
99. Jessica Pater, Amanda Coupe, Rachel Pfafman, Chanda Phelan, Tammy Toscos, and Maia Jacobs. 2021. Standardizing Reporting of Participant Compensation in HCI: A Systematic Literature Review and Recommendations for the Field. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, Article 141, 16 pages.
100. Dorian Peters, Susan Hansen, Jenny McMullan, Theresa Ardler, Janet Mooney, and Rafael A. Calvo. 2018. “Participation Is Not Enough”: Towards Indigenous-Led Co-Design. In Proceedings of the 30th Australian Conference on Computer-Human Interaction(OzCHI ’18). Association for Computing Machinery, New York, NY, USA, 97–101. https://doi.org/10.1145/3292147.3292204
101. Jennifer Pierre, Roderic Crooks, Morgan Currie, Britt Paris, and Irene Pasquetto. 2021. Getting Ourselves Together: Data-Centered Participatory Design Research & Epistemic Burden. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems(CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3411764.3445103
102. Kathleen H. Pine, Margaret M. Hinrichs, Jieshu Wang, Dana Lewis, and Erik Johnston. 2020. For Impactful Community Engagement: Check Your Role. Commun. ACM 63, 7 (June 2020), 26–28. https://doi.org/10.1145/3401720
103. Robert Racadio, Emma J. Rose, and Beth E. Kolko. 2014. Research at the Margin: Participatory Design and Community Based Participatory Research. In Proceedings of the 13th Participatory Design Conference: Short Papers, Industry Cases, Workshop Descriptions, Doctoral Consortium Papers, and Keynote Abstracts - Volume 2(PDC ’14). Association for Computing Machinery, New York, NY, USA, 49–52. https://doi.org/10.1145/2662155.2662188
104. Richard Rorty. 1979. Philosophy and the Mirror of Nature. Princeton University Press, New Jersey, USA.
105. Daniela K. Rosner, Saba Kawas, Wenqi Li, Nicole Tilly, and Yi-Chen Sung. 2016. Out of Time, out of Place: Reflections on Design Workshops as a Research Method. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing(CSCW ’16). Association for Computing Machinery, New York, NY, USA, 1131–1141. https://doi.org/10.1145/2818048.2820021
106. Amalia G. Sabiescu, Salomão David, Izak van Zyl, and Lorenzo Cantoni. 2014. Emerging Spaces in Community-Based Participatory Design: Reflections from Two Case Studies. In Proceedings of the 13th Participatory Design Conference: Research Papers - Volume 1(PDC ’14). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/2661435.2661446
107. Elizabeth B.-N. Sanders and Pieter Jan Stappers. 2008. Co-Creation and the New Landscapes of Design. CoDesign : International Journal of CoCreation in Design and the Arts 4, 1(2008), 5–18. https://doi.org/10.1080/15710880701875068
108. Darcell P Scharff, Katherine J Mathews, Pamela Jackson, Jonathan Hoffsuemmer, Emeobong Martin, and Dorothy Edwards. 2010. More than Tuskegee: Understanding Mistrust about Research Participation. Journal of Health Care for the Poor and Underserved 21, 3(2010), 879.
109. K. Shilton, N. Ramanathan, S. Reddy, V. Samanta, J. Burke, D. Estrin, M. Hansen, and M. Srivastava. 2008. Participatory Design of Sensing Networks: Strengths and Challenges. In Proceedings of the Tenth Anniversary Conference on Participatory Design 2008(PDC ’08). Indiana University, USA, 282–285.
110. Will Simm, Maria Angela Ferrario, Adrian Gradinar, and Jon Whittle. 2014. Prototyping ’Clasp’: Implications for Designing Digital Technology for and with Adults with Autism. In Proceedings of the 2014 Conference on Designing Interactive Systems(DIS ’14). Association for Computing Machinery, New York, NY, USA, 345–354. https://doi.org/10.1145/2598510.2600880
111. W. Michele Simmons and Timothy R. Amidon. 2019. Negotiating Research Stance: An Ecology of Tensions in the Design and Practice of Community-Engaged Research. In Proceedings of the 37th ACM International Conference on the Design of Communication(SIGDOC ’19). Association for Computing Machinery, New York, NY, USA, Article 20, 11 pages. https://doi.org/10.1145/3328020.3353955
112. Mona Sloane, Emanuel Moss, Olaitan Awomolo, and Laura Forlano. 2020. Participation is not a Design Fix for Machine Learning. arxiv:2007.02423 [cs.CY]
113. Katta Spiel, Kathrin Gerling, Cynthia L Bennett, Emeline Brulé, Rua M Williams, Jennifer Rode, and Jennifer Mankoff. 2020. Nothing about Us without Us: Investigating the Role of Critical Disability Studies in HCI. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–8.
114. Fiona Ssozi-Mugarura, Edwin Blake, and Ulrike Rivett. 2016. Supporting Community Needs for Rural Water Management through Community-Based Co-Design. In Proceedings of the 14th Participatory Design Conference(PDC ’16). Association for Computing Machinery, New York, NY, USA, 91–100. https://doi.org/10.1145/2940299.2940311
115. Larry Stillman. 2013. Participatory Action Research & Inclusive Information and Knowledge Management for Empowerment. In Proceedings of the Sixth International Conference on Information and Communications Technologies and Development: Notes - Volume 2(ICTD ’13). Association for Computing Machinery, New York, NY, USA, 163–166. https://doi.org/10.1145/2517899.2517903
116. Larry Stillman, Marlien Herselman, Mario Marais, Mmamakanye Pitse Boshomane, Paul Plantinga, and Sheelagh Walton. 2012. Digital Doorway: Social-technical Innovation for High-Needs Communities. The Electronic Journal of Information Systems in Developing Countries 50, 1(2012), 1–18. https://doi.org/10.1002/j.1681-4835.2012.tb00352.x
117. Elizabeth Stowell, Teresa K. O’Leary, Everlyne Kimani, Michael K. Paasche-Orlow, Timothy Bickmore, and Andrea G. Parker. 2020. Investigating Opportunities for Crowdsourcing in Church-Based Health Interventions: A Participatory Design Study. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12.
118. Ernest T. Stringer. 2007. Action Research (thirded.). SAGE Publications, Thousand Oaks, California.
119. Barsa Tandukar, Pooja Vazirani, and Aqueasha Martin-Hammond. 2021. Advocacy through Design: Partnering to Improve Online Communications and Connections in a Life Plan Community. In Designing Interactive Systems Conference 2021. Association for Computing Machinery, New York, NY, USA, 1695–1709.
120. Mamello Thinyane, Karthik Bhat, Lauri Goldkind, and Vikram Kamath Cannanure. 2018. Critical Participatory Design: Reflections on Engagement and Empowerment in a Case of a Community Based Organization. In Proceedings of the 15th Participatory Design Conference: Full Papers - Volume 1(PDC ’18). Association for Computing Machinery, New York, NY, USA, Article 2, 10 pages. https://doi.org/10.1145/3210586.3210601
121. S B Thomas and S C Quinn. 1991. The Tuskegee Syphilis Study, 1932 to 1972: Implications for HIV Education and AIDS Risk Education Programs in the Black Community.American Journal of Public Health 81, 11 (1991), 1498–1505. https://doi.org/10.2105/AJPH.81.11.1498
122. Einar Thorsrud. 1977. Democracy at Work: Norwegian Experiences with Nonbureaucratic Forms of Organization. The Journal of Applied Behavioral Science 13, 3 (1977), 410–421.
123. María Elena Torre, Michelle Fine, Brett G Stoudt, and Madeline Fox. 2012. Critical Participatory Action Research as Public Science. In APA Handbook of Research Methods in Psychology, Vol 2: Research Designs: Quantitative, Qualitative, Neuropsychological, and Biological., Harris Cooper, Paul M Camic, Debra L Long, A T Panter, David Rindskopf, and Kenneth J Sher (Eds.). American Psychological Association, Washington, 171–184.
124. Kim M Unertl, Chris L Schaefbauer, Terrance R Campbell, Charles Senteio, Katie A Siek, Suzanne Bakken, and Tiffany C Veinot. 2016. Integrating Community-Based Participatory Research and Informatics Approaches to Improve the Engagement and Health of Underserved Populations. Journal of the American Medical Informatics Association: JAMIA 23, 1 (Jan. 2016), 60–73. https://doi.org/10.1093/jamia/ocv094
125. Elyssa B Vasas. 2005. Examining the Margins: A Concept Analysis of Marginalization. Advances in Nursing Science 28, 3 (2005), 194–202.
126. Morgan Vigil-Hayes, Ann Futterman Collier, Shelby Hagemann, Giovanni Castillo, Keller Mikkelson, Joshua Dingman, Andrew Muñoz, Jade Luther, and Alexandra McLaughlin. 2021. Integrating Cultural Relevance into a Behavioral mHealth Intervention for Native American Youth. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 165 (April 2021), 29 pages. https://doi.org/10.1145/3449239
127. John Vines, Rachel Clarke, Peter Wright, John McCarthy, and Patrick Olivier. 2013. Configuring Participation: On How We Involve People in Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’13). Association for Computing Machinery, New York, NY, USA, 429–438. https://doi.org/10.1145/2470654.2470716
128. Nina B. Wallerstein and Bonnie Duran. 2006. Using Community-Based Participatory Research to Address Health Disparities. Health Promotion Practice 7, 3 (2006), 312–323. https://doi.org/10.1177/1524839906289376
129. Tiffani L Williams. 2020. ’Underrepresented Minority’ Considered Harmful, Racist Language. https://cacm.acm.org/blogs/blog-cacm/245710-underrepresented-minority-considered-harmful-racist-language/fulltext.
130. Heike Winschiers-Theophilus and Nicola J Bidwell. 2013. Toward an Afro-Centric Indigenous HCI Paradigm. International Journal of Human–Computer Interaction 29, 4 (March 2013), 243–255.
131. Anna Wojciechowska, Foad Hamidi, Andrés Lucero, and Jessica R. Cauchard. 2020. Chasing Lions: Co-designing Human-Drone Interaction in Sub-Saharan Africa. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. Association for Computing Machinery, New York, NY, USA, 141–152.
132. Peter Wright and John McCarthy. 2015. The Politics and Aesthetics of Participatory HCI. Interactions 22, 6 (Oct. 2015), 26–31. https://doi.org/10.1145/2828428
133. Bo Xie, Allison Druin, Jerry Fails, Sheri Massey, Evan Golub, Sonia Franckel, and Kiki Schneider. 2012. Connecting Generations: Developing Co-Design Methods for Older Adults and Children. Behaviour & Information Technology 31, 4 (2012), 413–423.
134. Ying Xu and Carleen Maitland. 2017. Mobilizing Assets: Data-driven Community Development with Refugees. In Proceedings of the Ninth International Conference on Information and Communication Technologies and Development(ICTD ’17). Association for Computing Machinery, New York, NY, USA, Article 10, 12 pages. https://doi.org/10.1145/3136560.3136579
135. Amanuel Zewge, Yvonne Dittrich, and Rahel Bekele. 2015. Adapting Participatory Design to Design Information System with Rural Ethiopian Community. In AFRICON 2015. IEEE, Addis Ababa, Ethiopia, 1–5. https://doi.org/10.1109/AFRCON.2015.7331974
136. Yang Zhao, Thomas Fitzpatrick, Bin Wan, Suzanne Day, Allison Mathews, and Joseph D Tucker. 2019. Forming and Implementing Community Advisory Boards in Low-and Middle-Income Countries: A Scoping Review. BMC medical ethics 20, 1 (2019), 1–11.
137. Randy Zhu, Dianna Hardy, and Trina Myers. 2019. Co-Designing with Adolescents with Autism Spectrum Disorder: From Ideation to Implementation. In Proceedings of the 31st Australian Conference on Human-Computer-Interaction(OZCHI’19). Association for Computing Machinery, New York, NY, USA, 106–116. https://doi.org/10.1145/3369457.3370914

Index Terms

• General and reference

  • Document types

    • Surveys and overviews

• Human-centered computing