Abstract
Crowdworkers regularly support their work with scripts, extensions, and software to enhance their productivity. Despite their evident significance, little is understood regarding how these tools affect crowdworkers' quality of life and work. In this study, we report findings from an interview study (N=21) aimed at exploring the tooling practices used by full-time crowdworkers on Amazon Mechanical Turk. Our interview data suggests that the tooling utilized by crowdworkers (1) strongly contributes to the fragmentation of microwork by enabling task switching and multitasking behavior; (2) promotes the fragmentation of crowdworkers' work-life boundaries by relying on tooling that encourages a 'work-anywhere' attitude; and (3) aids the fragmentation of social ties within worker communities through limited tooling access. Our findings have implications for building systems that unify crowdworkers' work practice in support of their productivity and well-being.
- 2013. UHRS - What, Where and How? A Small Guide for Beginners. https://www.clickworker.com/2013/09/10/ uhrs-was-wo-und-wie-ein-kleiner-guide-fur-neueinsteiger/Google Scholar
- 2019. Figure Eight. https://www.figure-eight.com/Google Scholar
- 2019. LeadGenius. https://www.leadgenius.com/Google Scholar
- Rachel F. Adler and Raquel Benbunan-Fich. 2013. Self-interruptions in discretionary multitasking. Computers in Human Behavior 29, 4 (7 2013), 1441--1449. https://doi.org/10.1016/j.chb.2013.01.040Google Scholar
- Erik M. Altmann and J. Gregory Trafton. 2002. Memory for goals: An activation-based model. Cognitive Science 26, 1 (2 2002), 39--83. https://doi.org/10.1016/S0364-0213(01)00058--1Google Scholar
- Renate Andersen and Anders I. Mørch. 2009. Mutual Development: A Case Study in Customer-Initiated Software Product Development. 31--49. https://doi.org/10.1007/978--3--642-00427--8{_}3Google Scholar
- Cecilie Schou Andreassen. 2014. Workaholism: An overview and current status of the research. Journal of Behavioral Addictions 3, 1 (3 2014), 1--11. https://doi.org/10.1556/JBA.2.2013.017Google Scholar
Cross Ref
- Brian P. Bailey and Joseph A. Konstan. 2006. On the need for attention-aware systems: Measuring effects of interruption on task performance, error rate, and affective state. Computers in Human Behavior 22, 4 (7 2006), 685--708. https://doi.org/10.1016/j.chb.2005.12.009Google Scholar
- Thomas Ball. 2017. Physical computing for everyone. In 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering Education and Training Track (ICSE-SEET). IEEE, 3--3. https://doi.org/10.1109/ICSE-SEET.2017.31Google Scholar
Digital Library
- Raquel Benbunan-Fich and Gregory E. Truman. 2009. Technical opinion: Multitasking with laptops during meetings. Commun. ACM 52, 2 (2 2009), 139. https://doi.org/10.1145/1461928.1461963Google Scholar
- Michael S. Bernstein, Desney Tan, Greg Smith, Mary Czerwinski, and Eric Horvitz. 2010. Personalization via friendsourcing. ACM Transactions on Computer-Human Interaction 17, 2 (5 2010), 1--28. https://doi.org/10.1145/1746259.1746260Google Scholar
Digital Library
- Alice M. Brawley and Cynthia L.S. Pury. 2016. Work experiences on MTurk: Job satisfaction, turnover, and information sharing. Computers in Human Behavior 54 (1 2016), 531--546. https://doi.org/10.1016/j.chb.2015.08.031Google Scholar
- Michael J. Brzozowski, Thomas Sandholm, and Tad Hogg. 2009. Effects of feedback and peer pressure on contributions to enterprise social media. In Proceedinfs of the ACM 2009 international conference on Supporting group work - GROUP'09. ACM Press, New York, New York, USA, 61. https://doi.org/10.1145/1531674.1531684Google Scholar
Digital Library
- Carrie J. Cai, Shamsi T. Iqbal, and Jaime Teevan. 2016. Chain Reactions: The Impact of Order on Microtask Chains. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, New York, New York, USA, 3143--3154. https://doi.org/10.1145/2858036.2858237Google Scholar
Digital Library
- Jesse Chandler, Pam Mueller, and Gabriele Paolacci. 2014. Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers. Behavior Research Methods 46, 1 (3 2014), 112--130. https://doi.org/10.3758/s13428-013-0365--7Google Scholar
- Justin Cheng, Jaime Teevan, Shamsi T. Iqbal, and Michael S. Bernstein. 2015. Break It Down: A Comparison of Macroand Microtasks. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15. ACM Press, New York, New York, USA, 4061--4064. https://doi.org/10.1145/2702123.2702146Google Scholar
- Edward Cutrell, Mary Czerwinski, and Eric Horvitz. 2001. Notification, Disruption, and Memory: Effects of Messaging Interruptions on Memory and Performance. Conference on Human-Computer Interaction Interact 2001 1999 (12 2001), 263--269.Google Scholar
- Mary Czerwinski, Eric Horvitz, and Susan Wilhite. 2004. A diary study of task switching and interruptions. In Proceedings of the 2004 conference on Human factors in computing systems - CHI '04. ACM Press, New York, New York, USA, 175--182. https://doi.org/10.1145/985692.985715Google Scholar
Digital Library
- Catalina Danis and David Singer. 2008. A wiki instance in the enterprise: opportunities, concerns and reality. In Proceedings of the ACM 2008 conference on Computer supported cooperative work - CSCW '08. ACM Press, New York, New York, USA, 495. https://doi.org/10.1145/1460563.1460642Google Scholar
Digital Library
- Valerio De Stefano. 2015. The rise of the just-in-time workforce: On-demand work, crowdwork, and labor protection in the gig-economy. Comp. Lab. L. d Pol'y J. 37 (2015), 471.Google Scholar
- Djellel Difallah, Elena Filatova, and Panos Ipeirotis. 2018. Demographics and Dynamics of Mechanical Turk Workers. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining - WSDM '18. ACM Press, New York, New York, USA, 135--143. https://doi.org/10.1145/3159652.3159661Google Scholar
Digital Library
- Anton N. Dragunov, Thomas G. Dietterich, Kevin Johnsrude, Matthew McLaughlin, Lida Li, and Jonathan L. Herlocker. 2005. TaskTracer. In Proceedings of the 10th international conference on Intelligent user interfaces - IUI '05. ACM Press, 75. https://doi.org/10.1145/1040830.1040855Google Scholar
- Lilia Efimova and Jonathan Grudin. 2007. Crossing Boundaries: A Case Study of Employee Blogging. In 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07). IEEE, 86--86. https://doi.org/10.1109/HICSS.2007.159Google Scholar
- Snehal (Neil) Gaikwad, Jeff Regino, Aditi Mithal, Adam Ginzberg, Aditi Nath, Karolina R. Ziulkoski, Trygve Cossette, Dilrukshi Gamage, Angela Richmond-Fuller, Ryo Suzuki, Jeerel Herrejón, Durim Morina, Kevin Le, Claudia Flores-Saviaga, Haritha Thilakarathne, Kajal Gupta, William Dai, Ankita Sastry, Shirish Goyal, Thejan Rajapakshe, Niki Abolhassani, Angela Xie, Rohit Nistala, Abigail Reyes, Surabhi Ingle, VerÃnica Jaramillo, Martin Godínez, Walter Ángel, Carlos Toxtli, Juan Flores, Asmita Gupta, Vineet Sethia, Diana Padilla, Megha Agarwal, Kristy Milland, Kristiono Setyadi, Nuwan Wajirasena, Muthitha Batagoda, Rolando Cruz, James Damon, Divya Nekkanti, Tejas Sarma, Mohamed Saleh, Gabriela Gongora-Svartzman, Alison Cossette, Soroosh Bateni, Gema Toledo Barrera, Alex Peña, Ryan Compton, Deen Aariff, Luis Palacios, Manuela Paula Ritter, Nisha K.K., Alan Kay, Jana Uhrmeister, Radhika Bhanu, Srivalli Nistala, Milad Esfahani, Elsa Bakiu, Christopher Diemert, Luca Matsumoto, Manik Singh, Krupa Patel, Ranjay Krishna, Geza Kovacs, Rajan Vaish, Saiph Savage, Michael Bernstein, Vishwajeet Narwal, and Karan Rajpal. 2015. Daemo: A Self-Governed Crowdsourcing Marketplace. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST '15 Adjunct. ACM Press, New York, New York, USA, 101--102. https://doi.org/10.1145/2815585.2815739Google Scholar
Digital Library
- Joseph A. Gonzales, Casey Fiesler, and Amy Bruckman. 2015. Towards an Appropriable CSCW Tool Ecology: Lessons from the Greatest International Scavenger Hunt the World Has Ever Seen. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW '15. ACM Press, New York, New York, USA, 946--957. https://doi.org/10.1145/2675133.2675240Google Scholar
Digital Library
- Victor M. González and Gloria Mark. 2004. "Constant, constant, multi-tasking craziness": managing multiple working spheres. In Proceedings of the 2004 conference on Human factors in computing systems - CHI '04. ACM Press, New York, New York, USA, 113--120. https://doi.org/10.1145/985692.985707Google Scholar
- Sandy J. J. Gould, Anna L. Cox, and Duncan P. Brumby. 2016. Diminished Control in Crowdsourcing: An Investigation of Crowdworker Multitasking Behavior. ACM Transactions on Computer-Human Interaction 23, 3 (6 2016), 1--29. https://doi.org/10.1145/2928269Google Scholar
Digital Library
- Mary L Gray and Siddharth Suri. 2019. Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass. Eamon Dolan Books.Google Scholar
- Mary L Gray, Siddharth Suri, Syed Shoaib Ali, and Deepti Kulkarni. 2016. The Crowd is a Collaborative Network. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing - CSCW '16. ACM Press, New York, New York, USA, 134--147. https://doi.org/10.1145/2818048.2819942Google Scholar
Digital Library
- Jonathan Grudin. 2001. Partitioning digital worlds: focal and peripheral awareness in multiple monitor use. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '01. ACM Press, New York, New York, USA, 458--465. https://doi.org/10.1145/365024.365312Google Scholar
Digital Library
- Lei Han, Kevin Roitero, Ujwal Gadiraju, Cristina Sarasua, Alessandro Checco, Eddy Maddalena, and Gianluca Demartini. 2019. All Those Wasted Hours: On Task Abandonment in Crowdsourcing. In Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining - WSDM '19. ACM Press, New York, New York, USA, 321--329. https://doi.org/10.1145/3289600.3291035Google Scholar
Digital Library
- Mark Handel and James D. Herbsleb. 2002. What is chat doing in the workplace?. In Proceedings of the 2002 ACM conference on Computer supported cooperative work - CSCW '02. ACM Press, New York, New York, USA, 1. https://doi.org/10.1145/587078.587080Google Scholar
- Benjamin V. Hanrahan, Jutta K. Willamowski, Saiganesh Swaminathan, and David B. Martin. 2015. TurkBench: Rendering the Market for Turkers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15. ACM Press, New York, New York, USA, 1613--1616. https://doi.org/10.1145/2702123.2702279Google Scholar
- Kotaro Hara, Abigail Adams, Kristy Milland, Saiph Savage, Chris Callison-Burch, and Jeffrey P. Bigham. 2018. A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--14. https://doi.org/10. 1145/3173574.3174023Google Scholar
- Jibo He, Ensar Becic, Yi Ching Lee, and Jason S. McCarley. 2011. Mind wandering behind the wheel: Performance and oculomotor correlates. Human Factors 53, 1 (2 2011), 13--21. https://doi.org/10.1177/0018720810391530Google Scholar
- Hilde Hetland, JÃÿrn Hetland, Cecilie Schou Andreassen, StÃle Pallesen, and Guy Notelaers. 2011. Leadership and fulfillment of the three basic psychological needs at work. Career Development International 16, 5 (9 2011), 507--523. https://doi.org/10.1108/13620431111168903Google Scholar
- Eric Horvitz, Carl Kadie, Tim Paek, and David Hovel. 2003. Models of attention in computing and communication. Commun. ACM 46, 3 (3 2003), 52. https://doi.org/10.1145/636772.636798Google Scholar
- James M. Hudson, Jim Christensen, Wendy A. Kellogg, and Thomas Erickson. 2002. "I'd be overwhelmed, but it's just one more thing to do": availability and interruption in research management. In Proceedings of the SIGCHI conference on Human factors in computing systems Changing our world, changing ourselves - CHI '02. ACM Press, New York, New York, USA, 97. https://doi.org/10.1145/503376.503394Google Scholar
Digital Library
- Ursula Huws and Simon Joyce. 2016. Crowd working survey: size of the UK's 'Gig Economy' revealed for the first time. Technical Report. http://www.feps-europe.eu/assets/a82bcd12-fb97--43a6--9346--24242695a183/crowd-working-surveypdf.pdfGoogle Scholar
- Ursula Huws and Simon Joyce. 2017. First survey results reveal high levels of crowd work in Switzerland. Technical Report. http://unieuropaprojects.org/content/uploads/2017-09--13-factsheet-ch.pdfGoogle Scholar
- Thanapong Intharah, Daniyar Turmukhambetov, and Gabriel J. Brostow. 2017. Help, It Looks Confusing: GUI Task Automation Through Demonstration and Follow-up Questions. In Proceedings of the 22nd International Conference on Intelligent User Interfaces - IUI '17. ACM Press, New York, New York, USA, 233--243. https://doi.org/10.1145/3025171.3025176Google Scholar
- Panagiotis G Ipeirotis. 2010. Demographics of mechanical turk. (2010).Google Scholar
- Shamsi Iqbal, Jaime Teevan, Dan Liebling, and Anne Loomis Thompson. 2018. Multitasking with Play Write, a Mobile Microproductivity Writing Tool (Forthcoming). In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology.Google Scholar
Digital Library
- Shamsi T. Iqbal and Eric Horvitz. 2007. Disruption and recovery of computing tasks. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '07. ACM Press, 677. https://doi.org/10.1145/1240624.1240730Google Scholar
- Shamsi T. Iqbal and Eric Horvitz. 2010. Notifications and awareness: A field study of alert usage and preferences. Proceedings of the 2010 ACM conference on Computer supported cooperative work - CSCW '10 (2010), 27--30. https://doi.org/10.1145/1718918.1718926Google Scholar
- Lilly C. Irani and M. Six Silberman. 2013. Turkopticon: interrupting worker invisibility in amazon mechanical turk. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '13. ACM Press, New York, New York, USA, 611. https://doi.org/10.1145/2470654.2470742Google Scholar
- Lilly C. Irani and M. Six Silberman. 2016. Stories We Tell About Labor: Turkopticon and the Trouble with "Design". In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, New York, New York, USA, 4573--4586. https://doi.org/10.1145/2858036.2858592Google Scholar
- Ellen Isaacs, AlanWalendowski, Steve Whittaker, Diane J. Schiano, and Candace Kamm. 2002. The character, functions, and styles of instant messaging in the workplace. In Proceedings of the 2002 ACM conference on Computer supported cooperative work - CSCW '02. ACM Press, New York, New York, USA, 11. https://doi.org/10.1145/587078.587081Google Scholar
Digital Library
- Mohammad Hossein Jarrahi and Will Sutherland. 2019. Algorithmic Management and Algorithmic Competencies: Understanding and Appropriating Algorithms in Gig Work. 578--589. https://doi.org/10.1007/978--3-030--15742--5{_}55Google Scholar
- Jing Jin and Laura A. Dabbish. 2009. Self-interruption on the computer: a typology of discretionary task interleaving. In Proceedings of the 27th international conference on Human factors in computing systems - CHI 09. ACM Press, New York, New York, USA, 1799. https://doi.org/10.1145/1518701.1518979Google Scholar
- Brigitte Jordan. 1996. Ethnographic workplace studies and CSCW. 17--42. https://doi.org/10.1016/S0923--8433(96) 80005-0Google Scholar
- Toni Kaplan, Susumu Saito, Kotaro Hara, and Jeffrey P Bigham. 2018. Striving to earn more: a survey of work strategies and tool use among crowd workers. In Sixth AAAI Conference on Human Computation and Crowdsourcing.Google Scholar
Cross Ref
- Pamela Karr-Wisniewski and Ying Lu. 2010. When more is too much: Operationalizing technology overload and exploring its impact on knowledge worker productivity. Computers in Human Behavior 26, 5 (9 2010), 1061--1072. https://doi.org/10.1016/j.chb.2010.03.008Google Scholar
- Keiko Katsuragawa, Qi Shu, and Edward Lank. 2019. PledgeWork: Online volunteering through crowdwork. In CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019). ACM Press, New York, New York, USA.Google Scholar
Digital Library
- Gabriella Kazai. 2011. In Search of Quality in Crowdsourcing for Search Engine Evaluation. 165--176. https: //doi.org/10.1007/978--3--642--20161--5{_}17Google Scholar
- Hyo Kim, Gwang Jae Kim, Han Woo Park, and Ronald E. Rice. 2007. Configurations of Relationships in Different Media: FtF, Email, Instant Messenger, Mobile Phone, and SMS. Journal of Computer-Mediated Communication 12, 4 (7 2007), 1183--1207. https://doi.org/10.1111/j.1083--6101.2007.00369.xGoogle Scholar
Cross Ref
- Aniket Kittur, Jeffrey Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013. The Future of CrowdWork. Proc. CSCW '13 (2013), 1--17. https://doi.org/10.1145/2441776.2441923Google Scholar
Digital Library
- Andrew J. Ko, Brad Myers, Mary Beth Rosson, Gregg Rothermel, Mary Shaw, Susan Wiedenbeck, Robin Abraham, Laura Beckwith, Alan Blackwell, Margaret Burnett, Martin Erwig, Chris Scaffidi, Joseph Lawrance, and Henry Lieberman. 2011. The state of the art in end-user software engineering. Comput. Surveys 43, 3 (4 2011), 1--44. https://doi.org/10.1145/1922649.1922658Google Scholar
- Ellen Ernst Kossek, Marian N. Ruderman, Phillip W. Braddy, and Kelly M. Hannum. 2012. Work-nonwork boundary management profiles: A person-centered approach. Journal of Vocational Behavior 81, 1 (8 2012), 112--128. https://doi.org/10.1016/j.jvb.2012.04.003Google Scholar
- Sandeep Krishnamurthy and Arvind K. Tripathi. 2009. Monetary donations to an open source software platform. Research Policy 38, 2 (3 2009), 404--414. https://doi.org/10.1016/j.respol.2008.11.004Google Scholar
- Siou Chew Kuek, Cecilia Paradi-Guilford, Toks Fayomi, Saori Imaizumi, Panos Ipeirotis, Patricia Pina, and Manpreet Singh. 2015. The global opportunity in online outsourcing. (2015).Google Scholar
- Laura Lascau, Sandy Gould, E Cox Anna amd Karmannaya, and Duncan Brumby. 2019. Monotasking or Multitasking: Designing for Crowdworkers' Preferences. In CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019). ACM Press, New York, New York, USA. https://doi.org/10.1145/3290605.3300649Google Scholar
Digital Library
- Walter S. Lasecki, Jeffrey M. Rzeszotarski, Adam Marcus, and Jeffrey P. Bigham. 2015. The Effects of Sequence and Delay on Crowd Work. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15. ACM Press, New York, New York, USA, 1375--1378. https://doi.org/10.1145/2702123.2702594Google Scholar
- Edith Law, Ming Yin, Joslin Goh, Kevin Chen, Michael A. Terry, and Krzysztof Z. Gajos. 2016. Curiosity Killed the Cat, but Makes Crowdwork Better. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, New York, New York, USA, 4098--4110. https://doi.org/10.1145/2858036.2858144Google Scholar
- Vili Lehdonvirta. 2018. Flexibility in the gig economy: managing time on three online piecework platforms. New Technology, Work and Employment 33, 1 (3 2018), 13--29. https://doi.org/10.1111/ntwe.12102Google Scholar
- Sophie Leroy. 2009. Why is it so hard to do my work? The challenge of attention residue when switching between work tasks. Organizational Behavior and Human Decision Processes 109, 2 (7 2009), 168--181. https://doi.org/10.1016/j.obhdp.2009.04.002Google Scholar
- Gilly Leshed, Eben M. Haber, Tara Matthews, and Tessa Lau. 2008. CoScripter: automating & sharing how-to knowledge in the enterprise. In Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems - CHI '08. ACM Press, New York, New York, USA, 1719. https://doi.org/10.1145/1357054.1357323Google Scholar
- Henry Lieberman, Fabio Paternò, Markus Klann, and Volker Wulf. [n. d.]. End-User Development: An Emerging Paradigm. In End User Development. Springer Netherlands, Dordrecht, 1--8. https://doi.org/10.1007/1--4020--5386-X{_}1Google Scholar
- Craig R. Littler. 1978. Understanding Taylorism. The British Journal of Sociology 29, 2 (6 1978), 185. https://doi.org/10.2307/589888Google Scholar
Cross Ref
- Yuhan Luo, Bongshin Lee, Donghee Yvette Wohn, Amanda L. Rebar, David E. Conroy, and Eun Kyoung Choe. 2018. Time for Break: Understanding Information Workers' Sedentary Behavior Through a Break Prompting System. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--14. https://doi.org/10.1145/3173574.3173701Google Scholar
Digital Library
- James Manyika, Susan Lund, Jacques Bughin, Kelsey Robinson, Jan Mischke, and Deepa Mahajan. 2016. Independent work: Choice, necessity, and the gig economy. McKinsey Global Institute (2016).Google Scholar
- Anoush Margaryan. 2019. Workplace Learning in Crowdwork: Comparing Microworkers' and Online Freelancers' Practices. Journal of Workplace Learning 31, 4 (5 2019), 250--273. https://doi.org/10.1108/JWL-10--2018-0126Google Scholar
Cross Ref
- Gloria Mark, Victor M. Gonzalez, and Justin Harris. 2005. No task left behind?: examining the nature of fragmented work. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '05. ACM Press, New York, New York, USA, 321. https://doi.org/10.1145/1054972.1055017Google Scholar
Digital Library
- Gloria Mark, Shamsi Iqbal, and Mary Czerwinski. 2017. How blocking distractions affects workplace focus and productivity. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers on - UbiComp '17. ACM Press, New York, New York, USA, 928--934. https://doi.org/10.1145/3123024.3124558Google Scholar
Digital Library
- David Martin, Jacki O'Neill, Neha Gupta, and Benjamin V. Hanrahan. 2016. Turking in a Global Labour Market. Computer Supported Cooperative Work (CSCW) 25, 1 (2 2016), 39--77. https://doi.org/10.1007/s10606-015--9241--6Google Scholar
- Winter Mason and Siddharth Suri. 2012. Conducting behavioral research on Amazon's Mechanical Turk. Behavior Research Methods 44, 1 (2012), 1--23. https://doi.org/10.3758/s13428-011-0124--6Google Scholar
- Robert R McCrae and Paul T Costa Jr. 1999. A five-factor theory of personality. Handbook of personality: Theory and research 2, 1999 (1999), 139--153.Google Scholar
- Brian McInnis, Dan Cosley, Chaebong Nam, and Gilly Leshed. 2016. Taking a HIT: Designing around Rejection, Mistrust, Risk, and Workers' Experiences in Amazon Mechanical Turk. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, New York, New York, USA, 2271--2282. https://doi.org/10.1145/2858036.2858539Google Scholar
Digital Library
- Andre N. Meyer, Thomas Fritz, Gail C. Murphy, and Thomas Zimmermann. 2014. Software developers' perceptions of productivity. In Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering - FSE 2014. ACM Press, New York, New York, USA, 19--29. https://doi.org/10.1145/2635868.2635892Google Scholar
Digital Library
- Elizabeth A. Necka, Stephanie Cacioppo, Greg J. Norman, and John T. Cacioppo. 2016. Measuring the Prevalence of Problematic Respondent Behaviors among MTurk, Campus, and Community Participants. PLOS ONE 11, 6 (6 2016), e0157732. https://doi.org/10.1371/journal.pone.0157732Google Scholar
- Brid O'Conaill and David Frohlich. 1995. Timespace in the workplace. In Conference companion on Human factors in computing systems - CHI '95, Vol. 17. 262--263. https://doi.org/10.1145/223355.223665Google Scholar
Digital Library
- Tadashi Okoshi, Julian Ramos, Hiroki Nozaki, Jin Nakazawa, Anind K. Dey, and Hideyuki Tokuda. 2015. Reducing users' perceived mental effort due to interruptive notifications in multi-device mobile environments. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing - UbiComp '15. ACM Press, New York, New York, USA, 475--486. https://doi.org/10.1145/2750858.2807517Google Scholar
Digital Library
- Leslie A. Perlow. 1999. The Time Famine: Toward a Sociology of Work Time. Administrative Science Quarterly 44, 1 (3 1999), 57. https://doi.org/10.2307/2667031Google Scholar
- Elizabeth M. Poposki and Frederick L. Oswald. 2010. The Multitasking Preference Inventory: Toward an Improved Measure of Individual Differences in Polychronicity. Human Performance 23, 3 (6 2010), 247--264. https://doi.org/10.1080/08959285.2010.487843Google Scholar
- Akshay Rao, Harmanpreet Kaur, and Walter S Lasecki. 2018. Plexiglass: Multiplexing Passive and Active Tasks for More Efficient Crowdsourcing. In Sixth AAAI Conference on Human Computation and Crowdsourcing.Google Scholar
- Susumu Saito, Chun-Wei Chiang, Saiph Savage, Teppei Nakano, Tetsunori Kobayashi, and Jeffrey Bigham. 2019. TurkScanner: Predicting the Hourly Wage of Microtasks. arXiv preprint arXiv:1903.07032 (2019).Google Scholar
- Niloufar Salehi, Jaime Teevan, Shamsi Iqbal, and Ece Kamar. 2017. Communicating Context to the Crowd for Complex Writing Tasks. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW '17. ACM Press, New York, New York, USA, 1890--1901. https://doi.org/10.1145/2998181.2998332Google Scholar
Digital Library
- M. Six Silberman, Bill Tomlinson, Rochelle LaPlante, Joel Ross, Lilli Irani, and Andrew Zaldivar. 2018. Responsible research with crowds: pay crowdworkers at least minimum wage. Commun. ACM 61, 3 (2 2018), 39--41. https://doi.org/10.1145/3180492Google Scholar
Digital Library
- Don Slater, Jo A Tacchi, and Peter A Lewis. 2002. Ethnographic monitoring and evaluation of community multimedia centres: A study of Kothmale community radio Internet project, Sri Lanka. (2002).Google Scholar
- Jean Y. Song, Raymond Fok, Alan Lundgard, Fan Yang, Juho Kim, and Walter S. Lasecki. 2018. Two Tools are Better Than One: Tool Diversity as a Means of Improving Aggregate Crowd Performance. In Proceedings of the 2018 Conference on Human Information Interaction&Retrieval - IUI '18. ACM Press, New York, New York, USA, 559--570. https://doi.org/10.1145/3172944.3172948Google Scholar
- Sabine Sonnentag and Caterina Schiffner. 2019. Psychological Detachment from Work during Nonwork Time and Employee Well-Being: The Role of Leader's Detachment. The Spanish Journal of Psychology 22 (3 2019), E3. https://doi.org/10.1017/sjp.2019.2Google Scholar
- James P Spradley. 1979. The ethnographic interview. Waveland Press.Google Scholar
- Will Sutherland and Mohammad Hossein Jarrahi. 2017. The Gig Economy and Information Infrastructure: The Case of the Digital Nomad Community. Proceedings of the ACM on Human-Computer Interaction 1, CSCW (12 2017), 1--24. https://doi.org/10.1145/3134732Google Scholar
Digital Library
- Toon W. Taris, Ilona Van Beek, and Wilmar B. Schaufeli. 2012. Demographic and Occupational Correlates of Workaholism. Psychological Reports 110, 2 (4 2012), 547--554. https://doi.org/10.2466/03.09.17.PR0.110.2.547--554Google Scholar
- Jaime Teevan. 2016. The future of microwork. XRDS: Crossroads, The ACM Magazine for Students 23, 2 (12 2016), 26--29. https://doi.org/10.1145/3019600Google Scholar
- Jaime Teevan, Shamsi T. Iqbal, and Curtis von Veh. 2016. Supporting Collaborative Writing with Microtasks. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, New York, New York, USA, 2657--2668. https://doi.org/10.1145/2858036.2858108Google Scholar
Digital Library
- Thea Turner, Pernilla Qvarfordt, Jacob T. Biehl, Gene Golovchinsky, and Maribeth Back. 2010. Exploring the workplace communication ecology. In Proceedings of the 28th international conference on Human factors in computing systems - CHI '10. ACM Press, New York, New York, USA, 841. https://doi.org/10.1145/1753326.1753449Google Scholar
Digital Library
- Donna Vakharia and Matthew Lease. 2015. Beyond Mechanical Turk: An Analysis of Paid Crowd Work Platforms.Google Scholar
- Max G. Van Kleek, Michael Bernstein, Katrina Panovich, Gregory G. Vargas, David R. Karger, and MC Schraefel. 2009. Note to self. In Proceedings of the 27th international conference on Human factors in computing systems - CHI 09. ACM Press, 1477. https://doi.org/10.1145/1518701.1518924Google Scholar
Digital Library
- R. van Solingen, E. Berghout, and F. van Latum. 1998. Interrupts: just a minute never is. IEEE Software 15, 5 (1998), 97--103. https://doi.org/10.1109/52.714843Google Scholar
Digital Library
- Stephen P. Whiteside and Donald R. Lynam. 2001. The Five Factor Model and impulsivity: using a structural model of personality to understand impulsivity. Personality and Individual Differences 30, 4 (3 2001), 669--689. https://doi.org/10.1016/S0191--8869(00)00064--7Google Scholar
- Alex C. Williams, Harmanpreet Kaur, Gloria Mark, Anne Loomis Thompson, Shamsi T. Iqbal, and Jaime Teevan. 2018. Supporting Workplace Detachment and Reattachment with Conversational Intelligence. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--13. https://doi.org/10.1145/3173574.3173662Google Scholar
Digital Library
- Alex C. Williams, Harmanpreet Kaur, Jaime Teevan, Ryen White, Shamsi Iqbal, and Adam Fourney. 2019. Mercury: Empowering Programmers' Mobile Work Practices with Microproductivity. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. ACM Press, New Orleans, Louisana, USA. https://doi.org/10.1145/3332165.3347932Google Scholar
Digital Library
- Alex J Wood, Mark Graham, Vili Lehdonvirta, and Isis Hjorth. 2019. Good Gig, Bad Gig: Autonomy and Algorithmic Control in the Global Gig Economy. Work, Employment and Society 33, 1 (2 2019), 56--75. https://doi.org/10.1177/ 0950017018785616Google Scholar
- Ming Yin, Mary L. Gray, Siddharth Suri, and Jennifer Wortman Vaughan. 2016. The Communication Network Within the Crowd. In Proceedings of the 25th International Conference on World Wide Web - WWW '16. ACM Press, New York, New York, USA, 1293--1303. https://doi.org/10.1145/2872427.2883036Google Scholar
Digital Library
- Ming Yin, Siddharth Suri, and Mary L. Gray. 2018. Running Out of Time: The Impact and Value of Flexibility in On-Demand Crowdwork. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--11. https://doi.org/10.1145/3173574.3174004Google Scholar
Index Terms
The Perpetual Work Life of Crowdworkers: How Tooling Practices Increase Fragmentation in Crowdwork
Recommendations
Monotasking or Multitasking: Designing for Crowdworkers' Preferences
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsCrowdworkers receive no formal training for managing their tasks, time or working environment. To develop tools that support such workers, an understanding of their preferences and the constraints they are under is essential. We asked 317 experienced ...
Back to the future of organizational work: crowdsourcing and digital work marketplaces
CSCW Companion '14: Proceedings of the companion publication of the 17th ACM conference on Computer supported cooperative work & social computingBusinesses increasingly accomplish work through innovative sourcing models that leverage the crowd. As a new way of distributing work across units within an organization and as a form of outsourcing work beyond organizational boundaries, crowdwork is ...
Crowdworkers, social affirmation and work identity: Rethinking dominant assumptions of crowdwork
AbstractCrowdwork is becoming increasingly popular as evidenced by its rapid growth. It is a new way of working that is conducted through global digital platforms where money is exchanged for services provided online. As it is digitally ...
Highlights- In the absence of organisational and occupational referent, crowdworkers rely on social affirmation for their work identity.






Comments