skip to main content
research-article

The Perpetual Work Life of Crowdworkers: How Tooling Practices Increase Fragmentation in Crowdwork

Published:07 November 2019Publication History
Skip Abstract Section

Abstract

Crowdworkers regularly support their work with scripts, extensions, and software to enhance their productivity. Despite their evident significance, little is understood regarding how these tools affect crowdworkers' quality of life and work. In this study, we report findings from an interview study (N=21) aimed at exploring the tooling practices used by full-time crowdworkers on Amazon Mechanical Turk. Our interview data suggests that the tooling utilized by crowdworkers (1) strongly contributes to the fragmentation of microwork by enabling task switching and multitasking behavior; (2) promotes the fragmentation of crowdworkers' work-life boundaries by relying on tooling that encourages a 'work-anywhere' attitude; and (3) aids the fragmentation of social ties within worker communities through limited tooling access. Our findings have implications for building systems that unify crowdworkers' work practice in support of their productivity and well-being.

References

  1. 2013. UHRS - What, Where and How? A Small Guide for Beginners. https://www.clickworker.com/2013/09/10/ uhrs-was-wo-und-wie-ein-kleiner-guide-fur-neueinsteiger/Google ScholarGoogle Scholar
  2. 2019. Figure Eight. https://www.figure-eight.com/Google ScholarGoogle Scholar
  3. 2019. LeadGenius. https://www.leadgenius.com/Google ScholarGoogle Scholar
  4. Rachel F. Adler and Raquel Benbunan-Fich. 2013. Self-interruptions in discretionary multitasking. Computers in Human Behavior 29, 4 (7 2013), 1441--1449. https://doi.org/10.1016/j.chb.2013.01.040Google ScholarGoogle Scholar
  5. Erik M. Altmann and J. Gregory Trafton. 2002. Memory for goals: An activation-based model. Cognitive Science 26, 1 (2 2002), 39--83. https://doi.org/10.1016/S0364-0213(01)00058--1Google ScholarGoogle Scholar
  6. Renate Andersen and Anders I. Mørch. 2009. Mutual Development: A Case Study in Customer-Initiated Software Product Development. 31--49. https://doi.org/10.1007/978--3--642-00427--8{_}3Google ScholarGoogle Scholar
  7. Cecilie Schou Andreassen. 2014. Workaholism: An overview and current status of the research. Journal of Behavioral Addictions 3, 1 (3 2014), 1--11. https://doi.org/10.1556/JBA.2.2013.017Google ScholarGoogle ScholarCross RefCross Ref
  8. Brian P. Bailey and Joseph A. Konstan. 2006. On the need for attention-aware systems: Measuring effects of interruption on task performance, error rate, and affective state. Computers in Human Behavior 22, 4 (7 2006), 685--708. https://doi.org/10.1016/j.chb.2005.12.009Google ScholarGoogle Scholar
  9. Thomas Ball. 2017. Physical computing for everyone. In 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering Education and Training Track (ICSE-SEET). IEEE, 3--3. https://doi.org/10.1109/ICSE-SEET.2017.31Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Raquel Benbunan-Fich and Gregory E. Truman. 2009. Technical opinion: Multitasking with laptops during meetings. Commun. ACM 52, 2 (2 2009), 139. https://doi.org/10.1145/1461928.1461963Google ScholarGoogle Scholar
  11. Michael S. Bernstein, Desney Tan, Greg Smith, Mary Czerwinski, and Eric Horvitz. 2010. Personalization via friendsourcing. ACM Transactions on Computer-Human Interaction 17, 2 (5 2010), 1--28. https://doi.org/10.1145/1746259.1746260Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Alice M. Brawley and Cynthia L.S. Pury. 2016. Work experiences on MTurk: Job satisfaction, turnover, and information sharing. Computers in Human Behavior 54 (1 2016), 531--546. https://doi.org/10.1016/j.chb.2015.08.031Google ScholarGoogle Scholar
  13. Michael J. Brzozowski, Thomas Sandholm, and Tad Hogg. 2009. Effects of feedback and peer pressure on contributions to enterprise social media. In Proceedinfs of the ACM 2009 international conference on Supporting group work - GROUP'09. ACM Press, New York, New York, USA, 61. https://doi.org/10.1145/1531674.1531684Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Carrie J. Cai, Shamsi T. Iqbal, and Jaime Teevan. 2016. Chain Reactions: The Impact of Order on Microtask Chains. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, New York, New York, USA, 3143--3154. https://doi.org/10.1145/2858036.2858237Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Jesse Chandler, Pam Mueller, and Gabriele Paolacci. 2014. Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers. Behavior Research Methods 46, 1 (3 2014), 112--130. https://doi.org/10.3758/s13428-013-0365--7Google ScholarGoogle Scholar
  16. Justin Cheng, Jaime Teevan, Shamsi T. Iqbal, and Michael S. Bernstein. 2015. Break It Down: A Comparison of Macroand Microtasks. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15. ACM Press, New York, New York, USA, 4061--4064. https://doi.org/10.1145/2702123.2702146Google ScholarGoogle Scholar
  17. Edward Cutrell, Mary Czerwinski, and Eric Horvitz. 2001. Notification, Disruption, and Memory: Effects of Messaging Interruptions on Memory and Performance. Conference on Human-Computer Interaction Interact 2001 1999 (12 2001), 263--269.Google ScholarGoogle Scholar
  18. Mary Czerwinski, Eric Horvitz, and Susan Wilhite. 2004. A diary study of task switching and interruptions. In Proceedings of the 2004 conference on Human factors in computing systems - CHI '04. ACM Press, New York, New York, USA, 175--182. https://doi.org/10.1145/985692.985715Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Catalina Danis and David Singer. 2008. A wiki instance in the enterprise: opportunities, concerns and reality. In Proceedings of the ACM 2008 conference on Computer supported cooperative work - CSCW '08. ACM Press, New York, New York, USA, 495. https://doi.org/10.1145/1460563.1460642Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Valerio De Stefano. 2015. The rise of the just-in-time workforce: On-demand work, crowdwork, and labor protection in the gig-economy. Comp. Lab. L. d Pol'y J. 37 (2015), 471.Google ScholarGoogle Scholar
  21. Djellel Difallah, Elena Filatova, and Panos Ipeirotis. 2018. Demographics and Dynamics of Mechanical Turk Workers. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining - WSDM '18. ACM Press, New York, New York, USA, 135--143. https://doi.org/10.1145/3159652.3159661Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Anton N. Dragunov, Thomas G. Dietterich, Kevin Johnsrude, Matthew McLaughlin, Lida Li, and Jonathan L. Herlocker. 2005. TaskTracer. In Proceedings of the 10th international conference on Intelligent user interfaces - IUI '05. ACM Press, 75. https://doi.org/10.1145/1040830.1040855Google ScholarGoogle Scholar
  23. Lilia Efimova and Jonathan Grudin. 2007. Crossing Boundaries: A Case Study of Employee Blogging. In 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07). IEEE, 86--86. https://doi.org/10.1109/HICSS.2007.159Google ScholarGoogle Scholar
  24. Snehal (Neil) Gaikwad, Jeff Regino, Aditi Mithal, Adam Ginzberg, Aditi Nath, Karolina R. Ziulkoski, Trygve Cossette, Dilrukshi Gamage, Angela Richmond-Fuller, Ryo Suzuki, Jeerel Herrejón, Durim Morina, Kevin Le, Claudia Flores-Saviaga, Haritha Thilakarathne, Kajal Gupta, William Dai, Ankita Sastry, Shirish Goyal, Thejan Rajapakshe, Niki Abolhassani, Angela Xie, Rohit Nistala, Abigail Reyes, Surabhi Ingle, VerÃnica Jaramillo, Martin Godínez, Walter Ángel, Carlos Toxtli, Juan Flores, Asmita Gupta, Vineet Sethia, Diana Padilla, Megha Agarwal, Kristy Milland, Kristiono Setyadi, Nuwan Wajirasena, Muthitha Batagoda, Rolando Cruz, James Damon, Divya Nekkanti, Tejas Sarma, Mohamed Saleh, Gabriela Gongora-Svartzman, Alison Cossette, Soroosh Bateni, Gema Toledo Barrera, Alex Peña, Ryan Compton, Deen Aariff, Luis Palacios, Manuela Paula Ritter, Nisha K.K., Alan Kay, Jana Uhrmeister, Radhika Bhanu, Srivalli Nistala, Milad Esfahani, Elsa Bakiu, Christopher Diemert, Luca Matsumoto, Manik Singh, Krupa Patel, Ranjay Krishna, Geza Kovacs, Rajan Vaish, Saiph Savage, Michael Bernstein, Vishwajeet Narwal, and Karan Rajpal. 2015. Daemo: A Self-Governed Crowdsourcing Marketplace. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST '15 Adjunct. ACM Press, New York, New York, USA, 101--102. https://doi.org/10.1145/2815585.2815739Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Joseph A. Gonzales, Casey Fiesler, and Amy Bruckman. 2015. Towards an Appropriable CSCW Tool Ecology: Lessons from the Greatest International Scavenger Hunt the World Has Ever Seen. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW '15. ACM Press, New York, New York, USA, 946--957. https://doi.org/10.1145/2675133.2675240Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Victor M. González and Gloria Mark. 2004. "Constant, constant, multi-tasking craziness": managing multiple working spheres. In Proceedings of the 2004 conference on Human factors in computing systems - CHI '04. ACM Press, New York, New York, USA, 113--120. https://doi.org/10.1145/985692.985707Google ScholarGoogle Scholar
  27. Sandy J. J. Gould, Anna L. Cox, and Duncan P. Brumby. 2016. Diminished Control in Crowdsourcing: An Investigation of Crowdworker Multitasking Behavior. ACM Transactions on Computer-Human Interaction 23, 3 (6 2016), 1--29. https://doi.org/10.1145/2928269Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Mary L Gray and Siddharth Suri. 2019. Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass. Eamon Dolan Books.Google ScholarGoogle Scholar
  29. Mary L Gray, Siddharth Suri, Syed Shoaib Ali, and Deepti Kulkarni. 2016. The Crowd is a Collaborative Network. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing - CSCW '16. ACM Press, New York, New York, USA, 134--147. https://doi.org/10.1145/2818048.2819942Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Jonathan Grudin. 2001. Partitioning digital worlds: focal and peripheral awareness in multiple monitor use. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '01. ACM Press, New York, New York, USA, 458--465. https://doi.org/10.1145/365024.365312Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Lei Han, Kevin Roitero, Ujwal Gadiraju, Cristina Sarasua, Alessandro Checco, Eddy Maddalena, and Gianluca Demartini. 2019. All Those Wasted Hours: On Task Abandonment in Crowdsourcing. In Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining - WSDM '19. ACM Press, New York, New York, USA, 321--329. https://doi.org/10.1145/3289600.3291035Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Mark Handel and James D. Herbsleb. 2002. What is chat doing in the workplace?. In Proceedings of the 2002 ACM conference on Computer supported cooperative work - CSCW '02. ACM Press, New York, New York, USA, 1. https://doi.org/10.1145/587078.587080Google ScholarGoogle Scholar
  33. Benjamin V. Hanrahan, Jutta K. Willamowski, Saiganesh Swaminathan, and David B. Martin. 2015. TurkBench: Rendering the Market for Turkers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15. ACM Press, New York, New York, USA, 1613--1616. https://doi.org/10.1145/2702123.2702279Google ScholarGoogle Scholar
  34. Kotaro Hara, Abigail Adams, Kristy Milland, Saiph Savage, Chris Callison-Burch, and Jeffrey P. Bigham. 2018. A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--14. https://doi.org/10. 1145/3173574.3174023Google ScholarGoogle Scholar
  35. Jibo He, Ensar Becic, Yi Ching Lee, and Jason S. McCarley. 2011. Mind wandering behind the wheel: Performance and oculomotor correlates. Human Factors 53, 1 (2 2011), 13--21. https://doi.org/10.1177/0018720810391530Google ScholarGoogle Scholar
  36. Hilde Hetland, JÃÿrn Hetland, Cecilie Schou Andreassen, StÃle Pallesen, and Guy Notelaers. 2011. Leadership and fulfillment of the three basic psychological needs at work. Career Development International 16, 5 (9 2011), 507--523. https://doi.org/10.1108/13620431111168903Google ScholarGoogle Scholar
  37. Eric Horvitz, Carl Kadie, Tim Paek, and David Hovel. 2003. Models of attention in computing and communication. Commun. ACM 46, 3 (3 2003), 52. https://doi.org/10.1145/636772.636798Google ScholarGoogle Scholar
  38. James M. Hudson, Jim Christensen, Wendy A. Kellogg, and Thomas Erickson. 2002. "I'd be overwhelmed, but it's just one more thing to do": availability and interruption in research management. In Proceedings of the SIGCHI conference on Human factors in computing systems Changing our world, changing ourselves - CHI '02. ACM Press, New York, New York, USA, 97. https://doi.org/10.1145/503376.503394Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Ursula Huws and Simon Joyce. 2016. Crowd working survey: size of the UK's 'Gig Economy' revealed for the first time. Technical Report. http://www.feps-europe.eu/assets/a82bcd12-fb97--43a6--9346--24242695a183/crowd-working-surveypdf.pdfGoogle ScholarGoogle Scholar
  40. Ursula Huws and Simon Joyce. 2017. First survey results reveal high levels of crowd work in Switzerland. Technical Report. http://unieuropaprojects.org/content/uploads/2017-09--13-factsheet-ch.pdfGoogle ScholarGoogle Scholar
  41. Thanapong Intharah, Daniyar Turmukhambetov, and Gabriel J. Brostow. 2017. Help, It Looks Confusing: GUI Task Automation Through Demonstration and Follow-up Questions. In Proceedings of the 22nd International Conference on Intelligent User Interfaces - IUI '17. ACM Press, New York, New York, USA, 233--243. https://doi.org/10.1145/3025171.3025176Google ScholarGoogle Scholar
  42. Panagiotis G Ipeirotis. 2010. Demographics of mechanical turk. (2010).Google ScholarGoogle Scholar
  43. Shamsi Iqbal, Jaime Teevan, Dan Liebling, and Anne Loomis Thompson. 2018. Multitasking with Play Write, a Mobile Microproductivity Writing Tool (Forthcoming). In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology.Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Shamsi T. Iqbal and Eric Horvitz. 2007. Disruption and recovery of computing tasks. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '07. ACM Press, 677. https://doi.org/10.1145/1240624.1240730Google ScholarGoogle Scholar
  45. Shamsi T. Iqbal and Eric Horvitz. 2010. Notifications and awareness: A field study of alert usage and preferences. Proceedings of the 2010 ACM conference on Computer supported cooperative work - CSCW '10 (2010), 27--30. https://doi.org/10.1145/1718918.1718926Google ScholarGoogle Scholar
  46. Lilly C. Irani and M. Six Silberman. 2013. Turkopticon: interrupting worker invisibility in amazon mechanical turk. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '13. ACM Press, New York, New York, USA, 611. https://doi.org/10.1145/2470654.2470742Google ScholarGoogle Scholar
  47. Lilly C. Irani and M. Six Silberman. 2016. Stories We Tell About Labor: Turkopticon and the Trouble with "Design". In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, New York, New York, USA, 4573--4586. https://doi.org/10.1145/2858036.2858592Google ScholarGoogle Scholar
  48. Ellen Isaacs, AlanWalendowski, Steve Whittaker, Diane J. Schiano, and Candace Kamm. 2002. The character, functions, and styles of instant messaging in the workplace. In Proceedings of the 2002 ACM conference on Computer supported cooperative work - CSCW '02. ACM Press, New York, New York, USA, 11. https://doi.org/10.1145/587078.587081Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Mohammad Hossein Jarrahi and Will Sutherland. 2019. Algorithmic Management and Algorithmic Competencies: Understanding and Appropriating Algorithms in Gig Work. 578--589. https://doi.org/10.1007/978--3-030--15742--5{_}55Google ScholarGoogle Scholar
  50. Jing Jin and Laura A. Dabbish. 2009. Self-interruption on the computer: a typology of discretionary task interleaving. In Proceedings of the 27th international conference on Human factors in computing systems - CHI 09. ACM Press, New York, New York, USA, 1799. https://doi.org/10.1145/1518701.1518979Google ScholarGoogle Scholar
  51. Brigitte Jordan. 1996. Ethnographic workplace studies and CSCW. 17--42. https://doi.org/10.1016/S0923--8433(96) 80005-0Google ScholarGoogle Scholar
  52. Toni Kaplan, Susumu Saito, Kotaro Hara, and Jeffrey P Bigham. 2018. Striving to earn more: a survey of work strategies and tool use among crowd workers. In Sixth AAAI Conference on Human Computation and Crowdsourcing.Google ScholarGoogle ScholarCross RefCross Ref
  53. Pamela Karr-Wisniewski and Ying Lu. 2010. When more is too much: Operationalizing technology overload and exploring its impact on knowledge worker productivity. Computers in Human Behavior 26, 5 (9 2010), 1061--1072. https://doi.org/10.1016/j.chb.2010.03.008Google ScholarGoogle Scholar
  54. Keiko Katsuragawa, Qi Shu, and Edward Lank. 2019. PledgeWork: Online volunteering through crowdwork. In CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019). ACM Press, New York, New York, USA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Gabriella Kazai. 2011. In Search of Quality in Crowdsourcing for Search Engine Evaluation. 165--176. https: //doi.org/10.1007/978--3--642--20161--5{_}17Google ScholarGoogle Scholar
  56. Hyo Kim, Gwang Jae Kim, Han Woo Park, and Ronald E. Rice. 2007. Configurations of Relationships in Different Media: FtF, Email, Instant Messenger, Mobile Phone, and SMS. Journal of Computer-Mediated Communication 12, 4 (7 2007), 1183--1207. https://doi.org/10.1111/j.1083--6101.2007.00369.xGoogle ScholarGoogle ScholarCross RefCross Ref
  57. Aniket Kittur, Jeffrey Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013. The Future of CrowdWork. Proc. CSCW '13 (2013), 1--17. https://doi.org/10.1145/2441776.2441923Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Andrew J. Ko, Brad Myers, Mary Beth Rosson, Gregg Rothermel, Mary Shaw, Susan Wiedenbeck, Robin Abraham, Laura Beckwith, Alan Blackwell, Margaret Burnett, Martin Erwig, Chris Scaffidi, Joseph Lawrance, and Henry Lieberman. 2011. The state of the art in end-user software engineering. Comput. Surveys 43, 3 (4 2011), 1--44. https://doi.org/10.1145/1922649.1922658Google ScholarGoogle Scholar
  59. Ellen Ernst Kossek, Marian N. Ruderman, Phillip W. Braddy, and Kelly M. Hannum. 2012. Work-nonwork boundary management profiles: A person-centered approach. Journal of Vocational Behavior 81, 1 (8 2012), 112--128. https://doi.org/10.1016/j.jvb.2012.04.003Google ScholarGoogle Scholar
  60. Sandeep Krishnamurthy and Arvind K. Tripathi. 2009. Monetary donations to an open source software platform. Research Policy 38, 2 (3 2009), 404--414. https://doi.org/10.1016/j.respol.2008.11.004Google ScholarGoogle Scholar
  61. Siou Chew Kuek, Cecilia Paradi-Guilford, Toks Fayomi, Saori Imaizumi, Panos Ipeirotis, Patricia Pina, and Manpreet Singh. 2015. The global opportunity in online outsourcing. (2015).Google ScholarGoogle Scholar
  62. Laura Lascau, Sandy Gould, E Cox Anna amd Karmannaya, and Duncan Brumby. 2019. Monotasking or Multitasking: Designing for Crowdworkers' Preferences. In CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019). ACM Press, New York, New York, USA. https://doi.org/10.1145/3290605.3300649Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Walter S. Lasecki, Jeffrey M. Rzeszotarski, Adam Marcus, and Jeffrey P. Bigham. 2015. The Effects of Sequence and Delay on Crowd Work. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15. ACM Press, New York, New York, USA, 1375--1378. https://doi.org/10.1145/2702123.2702594Google ScholarGoogle Scholar
  64. Edith Law, Ming Yin, Joslin Goh, Kevin Chen, Michael A. Terry, and Krzysztof Z. Gajos. 2016. Curiosity Killed the Cat, but Makes Crowdwork Better. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, New York, New York, USA, 4098--4110. https://doi.org/10.1145/2858036.2858144Google ScholarGoogle Scholar
  65. Vili Lehdonvirta. 2018. Flexibility in the gig economy: managing time on three online piecework platforms. New Technology, Work and Employment 33, 1 (3 2018), 13--29. https://doi.org/10.1111/ntwe.12102Google ScholarGoogle Scholar
  66. Sophie Leroy. 2009. Why is it so hard to do my work? The challenge of attention residue when switching between work tasks. Organizational Behavior and Human Decision Processes 109, 2 (7 2009), 168--181. https://doi.org/10.1016/j.obhdp.2009.04.002Google ScholarGoogle Scholar
  67. Gilly Leshed, Eben M. Haber, Tara Matthews, and Tessa Lau. 2008. CoScripter: automating & sharing how-to knowledge in the enterprise. In Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems - CHI '08. ACM Press, New York, New York, USA, 1719. https://doi.org/10.1145/1357054.1357323Google ScholarGoogle Scholar
  68. Henry Lieberman, Fabio Paternò, Markus Klann, and Volker Wulf. [n. d.]. End-User Development: An Emerging Paradigm. In End User Development. Springer Netherlands, Dordrecht, 1--8. https://doi.org/10.1007/1--4020--5386-X{_}1Google ScholarGoogle Scholar
  69. Craig R. Littler. 1978. Understanding Taylorism. The British Journal of Sociology 29, 2 (6 1978), 185. https://doi.org/10.2307/589888Google ScholarGoogle ScholarCross RefCross Ref
  70. Yuhan Luo, Bongshin Lee, Donghee Yvette Wohn, Amanda L. Rebar, David E. Conroy, and Eun Kyoung Choe. 2018. Time for Break: Understanding Information Workers' Sedentary Behavior Through a Break Prompting System. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--14. https://doi.org/10.1145/3173574.3173701Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. James Manyika, Susan Lund, Jacques Bughin, Kelsey Robinson, Jan Mischke, and Deepa Mahajan. 2016. Independent work: Choice, necessity, and the gig economy. McKinsey Global Institute (2016).Google ScholarGoogle Scholar
  72. Anoush Margaryan. 2019. Workplace Learning in Crowdwork: Comparing Microworkers' and Online Freelancers' Practices. Journal of Workplace Learning 31, 4 (5 2019), 250--273. https://doi.org/10.1108/JWL-10--2018-0126Google ScholarGoogle ScholarCross RefCross Ref
  73. Gloria Mark, Victor M. Gonzalez, and Justin Harris. 2005. No task left behind?: examining the nature of fragmented work. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '05. ACM Press, New York, New York, USA, 321. https://doi.org/10.1145/1054972.1055017Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Gloria Mark, Shamsi Iqbal, and Mary Czerwinski. 2017. How blocking distractions affects workplace focus and productivity. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers on - UbiComp '17. ACM Press, New York, New York, USA, 928--934. https://doi.org/10.1145/3123024.3124558Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. David Martin, Jacki O'Neill, Neha Gupta, and Benjamin V. Hanrahan. 2016. Turking in a Global Labour Market. Computer Supported Cooperative Work (CSCW) 25, 1 (2 2016), 39--77. https://doi.org/10.1007/s10606-015--9241--6Google ScholarGoogle Scholar
  76. Winter Mason and Siddharth Suri. 2012. Conducting behavioral research on Amazon's Mechanical Turk. Behavior Research Methods 44, 1 (2012), 1--23. https://doi.org/10.3758/s13428-011-0124--6Google ScholarGoogle Scholar
  77. Robert R McCrae and Paul T Costa Jr. 1999. A five-factor theory of personality. Handbook of personality: Theory and research 2, 1999 (1999), 139--153.Google ScholarGoogle Scholar
  78. Brian McInnis, Dan Cosley, Chaebong Nam, and Gilly Leshed. 2016. Taking a HIT: Designing around Rejection, Mistrust, Risk, and Workers' Experiences in Amazon Mechanical Turk. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, New York, New York, USA, 2271--2282. https://doi.org/10.1145/2858036.2858539Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. Andre N. Meyer, Thomas Fritz, Gail C. Murphy, and Thomas Zimmermann. 2014. Software developers' perceptions of productivity. In Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering - FSE 2014. ACM Press, New York, New York, USA, 19--29. https://doi.org/10.1145/2635868.2635892Google ScholarGoogle ScholarDigital LibraryDigital Library
  80. Elizabeth A. Necka, Stephanie Cacioppo, Greg J. Norman, and John T. Cacioppo. 2016. Measuring the Prevalence of Problematic Respondent Behaviors among MTurk, Campus, and Community Participants. PLOS ONE 11, 6 (6 2016), e0157732. https://doi.org/10.1371/journal.pone.0157732Google ScholarGoogle Scholar
  81. Brid O'Conaill and David Frohlich. 1995. Timespace in the workplace. In Conference companion on Human factors in computing systems - CHI '95, Vol. 17. 262--263. https://doi.org/10.1145/223355.223665Google ScholarGoogle ScholarDigital LibraryDigital Library
  82. Tadashi Okoshi, Julian Ramos, Hiroki Nozaki, Jin Nakazawa, Anind K. Dey, and Hideyuki Tokuda. 2015. Reducing users' perceived mental effort due to interruptive notifications in multi-device mobile environments. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing - UbiComp '15. ACM Press, New York, New York, USA, 475--486. https://doi.org/10.1145/2750858.2807517Google ScholarGoogle ScholarDigital LibraryDigital Library
  83. Leslie A. Perlow. 1999. The Time Famine: Toward a Sociology of Work Time. Administrative Science Quarterly 44, 1 (3 1999), 57. https://doi.org/10.2307/2667031Google ScholarGoogle Scholar
  84. Elizabeth M. Poposki and Frederick L. Oswald. 2010. The Multitasking Preference Inventory: Toward an Improved Measure of Individual Differences in Polychronicity. Human Performance 23, 3 (6 2010), 247--264. https://doi.org/10.1080/08959285.2010.487843Google ScholarGoogle Scholar
  85. Akshay Rao, Harmanpreet Kaur, and Walter S Lasecki. 2018. Plexiglass: Multiplexing Passive and Active Tasks for More Efficient Crowdsourcing. In Sixth AAAI Conference on Human Computation and Crowdsourcing.Google ScholarGoogle Scholar
  86. Susumu Saito, Chun-Wei Chiang, Saiph Savage, Teppei Nakano, Tetsunori Kobayashi, and Jeffrey Bigham. 2019. TurkScanner: Predicting the Hourly Wage of Microtasks. arXiv preprint arXiv:1903.07032 (2019).Google ScholarGoogle Scholar
  87. Niloufar Salehi, Jaime Teevan, Shamsi Iqbal, and Ece Kamar. 2017. Communicating Context to the Crowd for Complex Writing Tasks. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW '17. ACM Press, New York, New York, USA, 1890--1901. https://doi.org/10.1145/2998181.2998332Google ScholarGoogle ScholarDigital LibraryDigital Library
  88. M. Six Silberman, Bill Tomlinson, Rochelle LaPlante, Joel Ross, Lilli Irani, and Andrew Zaldivar. 2018. Responsible research with crowds: pay crowdworkers at least minimum wage. Commun. ACM 61, 3 (2 2018), 39--41. https://doi.org/10.1145/3180492Google ScholarGoogle ScholarDigital LibraryDigital Library
  89. Don Slater, Jo A Tacchi, and Peter A Lewis. 2002. Ethnographic monitoring and evaluation of community multimedia centres: A study of Kothmale community radio Internet project, Sri Lanka. (2002).Google ScholarGoogle Scholar
  90. Jean Y. Song, Raymond Fok, Alan Lundgard, Fan Yang, Juho Kim, and Walter S. Lasecki. 2018. Two Tools are Better Than One: Tool Diversity as a Means of Improving Aggregate Crowd Performance. In Proceedings of the 2018 Conference on Human Information Interaction&Retrieval - IUI '18. ACM Press, New York, New York, USA, 559--570. https://doi.org/10.1145/3172944.3172948Google ScholarGoogle Scholar
  91. Sabine Sonnentag and Caterina Schiffner. 2019. Psychological Detachment from Work during Nonwork Time and Employee Well-Being: The Role of Leader's Detachment. The Spanish Journal of Psychology 22 (3 2019), E3. https://doi.org/10.1017/sjp.2019.2Google ScholarGoogle Scholar
  92. James P Spradley. 1979. The ethnographic interview. Waveland Press.Google ScholarGoogle Scholar
  93. Will Sutherland and Mohammad Hossein Jarrahi. 2017. The Gig Economy and Information Infrastructure: The Case of the Digital Nomad Community. Proceedings of the ACM on Human-Computer Interaction 1, CSCW (12 2017), 1--24. https://doi.org/10.1145/3134732Google ScholarGoogle ScholarDigital LibraryDigital Library
  94. Toon W. Taris, Ilona Van Beek, and Wilmar B. Schaufeli. 2012. Demographic and Occupational Correlates of Workaholism. Psychological Reports 110, 2 (4 2012), 547--554. https://doi.org/10.2466/03.09.17.PR0.110.2.547--554Google ScholarGoogle Scholar
  95. Jaime Teevan. 2016. The future of microwork. XRDS: Crossroads, The ACM Magazine for Students 23, 2 (12 2016), 26--29. https://doi.org/10.1145/3019600Google ScholarGoogle Scholar
  96. Jaime Teevan, Shamsi T. Iqbal, and Curtis von Veh. 2016. Supporting Collaborative Writing with Microtasks. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, New York, New York, USA, 2657--2668. https://doi.org/10.1145/2858036.2858108Google ScholarGoogle ScholarDigital LibraryDigital Library
  97. Thea Turner, Pernilla Qvarfordt, Jacob T. Biehl, Gene Golovchinsky, and Maribeth Back. 2010. Exploring the workplace communication ecology. In Proceedings of the 28th international conference on Human factors in computing systems - CHI '10. ACM Press, New York, New York, USA, 841. https://doi.org/10.1145/1753326.1753449Google ScholarGoogle ScholarDigital LibraryDigital Library
  98. Donna Vakharia and Matthew Lease. 2015. Beyond Mechanical Turk: An Analysis of Paid Crowd Work Platforms.Google ScholarGoogle Scholar
  99. Max G. Van Kleek, Michael Bernstein, Katrina Panovich, Gregory G. Vargas, David R. Karger, and MC Schraefel. 2009. Note to self. In Proceedings of the 27th international conference on Human factors in computing systems - CHI 09. ACM Press, 1477. https://doi.org/10.1145/1518701.1518924Google ScholarGoogle ScholarDigital LibraryDigital Library
  100. R. van Solingen, E. Berghout, and F. van Latum. 1998. Interrupts: just a minute never is. IEEE Software 15, 5 (1998), 97--103. https://doi.org/10.1109/52.714843Google ScholarGoogle ScholarDigital LibraryDigital Library
  101. Stephen P. Whiteside and Donald R. Lynam. 2001. The Five Factor Model and impulsivity: using a structural model of personality to understand impulsivity. Personality and Individual Differences 30, 4 (3 2001), 669--689. https://doi.org/10.1016/S0191--8869(00)00064--7Google ScholarGoogle Scholar
  102. Alex C. Williams, Harmanpreet Kaur, Gloria Mark, Anne Loomis Thompson, Shamsi T. Iqbal, and Jaime Teevan. 2018. Supporting Workplace Detachment and Reattachment with Conversational Intelligence. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--13. https://doi.org/10.1145/3173574.3173662Google ScholarGoogle ScholarDigital LibraryDigital Library
  103. Alex C. Williams, Harmanpreet Kaur, Jaime Teevan, Ryen White, Shamsi Iqbal, and Adam Fourney. 2019. Mercury: Empowering Programmers' Mobile Work Practices with Microproductivity. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. ACM Press, New Orleans, Louisana, USA. https://doi.org/10.1145/3332165.3347932Google ScholarGoogle ScholarDigital LibraryDigital Library
  104. Alex J Wood, Mark Graham, Vili Lehdonvirta, and Isis Hjorth. 2019. Good Gig, Bad Gig: Autonomy and Algorithmic Control in the Global Gig Economy. Work, Employment and Society 33, 1 (2 2019), 56--75. https://doi.org/10.1177/ 0950017018785616Google ScholarGoogle Scholar
  105. Ming Yin, Mary L. Gray, Siddharth Suri, and Jennifer Wortman Vaughan. 2016. The Communication Network Within the Crowd. In Proceedings of the 25th International Conference on World Wide Web - WWW '16. ACM Press, New York, New York, USA, 1293--1303. https://doi.org/10.1145/2872427.2883036Google ScholarGoogle ScholarDigital LibraryDigital Library
  106. Ming Yin, Siddharth Suri, and Mary L. Gray. 2018. Running Out of Time: The Impact and Value of Flexibility in On-Demand Crowdwork. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--11. https://doi.org/10.1145/3173574.3174004Google ScholarGoogle Scholar

Index Terms

  1. The Perpetual Work Life of Crowdworkers: How Tooling Practices Increase Fragmentation in Crowdwork

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!