Abstract
Digital assistive systems, enable workers with disabilities to perform complex industrial work. However, the previously presented systems considered only a single workplace and a single user. This paper presents an assembly line that enables a joint processing of complex tasks by multiple workers with and without disabilities. The aim was to investigate the use of interaction technologies such as in-situ projections and hand-tracking to enable the processing of complex assembly tasks by work teams with highly heterogeneous abilities. The developed assembly line assists users and coordinates the joint work by distributing single assembly steps to workers based on the individual workers' abilities. Besides presenting the concept and implementation of the assembly line, we report our findings after six months of operation. Our results indicate that using the assistive assembly line has positive impacts, such as increased satisfaction and independence of the workers combined with a higher productivity.
- Leila Aflatoony and Su Jin (Susan) Lee. 2020. AT makers: a multidisciplinary approach to co-designing assistive technologies by co-optimizing expert knowledge. In Proceedings of the 16th Participatory Design Conference 2020-Participation (s) Otherwise-Volume 2 . 128--132. Google Scholar
Digital Library
- Meghan Allen, Rock Leung, Joanna McGrenere, and Barbara Purves. 2008. Involving domain experts in assistive technology research. Universal Access in the Information Society , Vol. 7, 3 (2008), 145--154. Google Scholar
Digital Library
- Alexander Bannat, Jürgen Gast, Gerhard Rigoll, and Frank Wallhoff. 2008a. Event analysis and interpretation of human activity for augmented reality-based assistant systems. In 2008 4th International Conference on Intelligent Computer Communication and Processing. IEEE, 1--8.Google Scholar
Cross Ref
- Alexander Bannat, Frank Wallhoff, Gerhard Rigoll, Florian Friesdorf, Heiner Bubb, Sonja Stork, Hermann J Müller, Anna Schubö , Mathey Wiesbeck, Michael F Z"ah, et almbox. 2008b. Towards optimal worker assistance: a framework for adaptive selection and presentation of assembly instructions. In Proceedings of the 1st international workshop on cognition for technical systems, Cotesys .Google Scholar
- Sven Bendzioch, Dominic Bl"asing, and Sven Hinrichsen. 2019. Comparison of Different Assembly Assistance Systems Under Ergonomic and Economic Aspects. In International Conference on Human Systems Engineering and Design: Future Trends and Applications. Springer, 20--25.Google Scholar
- Martin Berg, Peter Friesenhahn, Andrea Stratmann, Jochen Walter, and Axel Willenberg. 2019. WERKSTATT IM WANDEL -- Jahresbericht 2018 [German]. https://www.bagwfbm.de/file/1221Google Scholar
- Hazel Boyd, Simon Jones, Nigel Harris, Niki Panteli, Jason Leake, and Roy Jones. 2014. Development and testing of the inTouch video link for people with dementia: Design approach and practical challenges. In 2014 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). IEEE, 608--612.Google Scholar
Cross Ref
- Bundesarbeitsgemeinschaft Werkstätten für behinderte Menschen e. V.. 2019. The system and services of sheltered workshops in Germany. https://www.bagwfbm.de/file/1168/Google Scholar
- Sebastian Büttner, Markus Funk, Oliver Sand, and Carsten Röcker. 2016. Using Head-Mounted Displays and In-Situ Projection for Assistive Systems: A Comparison. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments (Corfu, Island, Greece) (PETRA '16). Association for Computing Machinery, New York, NY, USA, Article 44, bibinfonumpages8 pages. https://doi.org/10.1145/2910674.2910679 Google Scholar
Digital Library
- Sebastian Büttner, Henrik Mucha, Markus Funk, Thomas Kosch, Mario Aehnelt, Sebastian Robert, and Carsten Röcker. 2017a. The Design Space of Augmented and Virtual Reality Applications for Assistive Environments in Manufacturing: A Visual Approach. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 433--440. Google Scholar
Digital Library
- Sebastian Büttner, Henrik Mucha, Sebastian Robert, Fabian Hellweg, and Carsten Röcker. 2017b. HCI in der SmartFactoryOWL -- Angewandte Forschung & Entwicklung [German]. Mensch und Computer 2017-Workshopband (2017).Google Scholar
- Sebastian Büttner, Michael Prilla, and Carsten Röcker. 2020. Augmented Reality Training for Industrial Assembly Work - Are Projection-Based AR Assistive Systems an Appropriate Tool for Assembly Training?. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3313831.3376720 Google Scholar
Digital Library
- Sebastian Büttner, Oliver Sand, and Carsten Röcker. 2017c. Exploring design opportunities for intelligent worker assistance: a new approach using projetion-based AR and a novel hand-tracking algorithm. In European Conference on Ambient Intelligence. Springer, 33--45.Google Scholar
Cross Ref
- Michael Fellmann, Sebastian Robert, Sebastian Büttner, Henrik Mucha, and Carsten Röcker. 2017. Towards a Framework for Assistance Systems to Support Work Processes in Smart Factories. In International Cross-Domain Conference for Machine Learning and Knowledge Extraction. Springer, Cham, 59--68.Google Scholar
Cross Ref
- Markus Funk. 2015. Assistive Augmentation at the Manual Assembly Workplace using In-Situ Projection . Dissertation. University of Stuttgart. https://elib.uni-stuttgart.de/handle/11682/9014Google Scholar
- Markus Funk, Andreas B"achler, Liane B"achler, Oliver Korn, Christoph Krieger, Thomas Heidenreich, and Albrecht Schmidt. 2015a. Comparing Projected In-Situ Feedback at the Manual Assembly Workplace with Impaired Workers. In Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments (Corfu, Greece) (PETRA '15). Association for Computing Machinery, New York, NY, USA, Article 1, bibinfonumpages8 pages. https://doi.org/10.1145/2769493.2769496 Google Scholar
Digital Library
- Markus Funk, Juana Heusler, Elif Akcay, Klaus Weiland, and Albrecht Schmidt. 2016a. Haptic, Auditory, or Visual? Towards Optimal Error Feedback at Manual Assembly Workplaces. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments (Corfu, Island, Greece) (PETRA '16). Association for Computing Machinery, New York, NY, USA, Article 43, bibinfonumpages6 pages. https://doi.org/10.1145/2910674.2910683 Google Scholar
Digital Library
- Markus Funk, Thomas Kosch, Romina Kettner, Oliver Korn, and Albrecht Schmidt. 2016c. motionEAP : An Overview of 4 Years of Combining Industrial Assembly with Augmented Reality for Industry 4. 0.Google Scholar
- Markus Funk, Thomas Kosch, and Albrecht Schmidt. 2016b. Interactive Worker Assistance: Comparing the Effects of in-Situ Projection, Head-Mounted Displays, Tablet, and Paper Instructions. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Heidelberg, Germany) (UbiComp '16). Association for Computing Machinery, New York, NY, USA, 934--939. https://doi.org/10.1145/2971648.2971706 Google Scholar
Digital Library
- Markus Funk, Sven Mayer, and Albrecht Schmidt. 2015b. Using In-Situ Projection to Support Cognitively Impaired Workers at the Workplace. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (Lisbon, Portugal) (ASSETS '15). Association for Computing Machinery, New York, NY, USA, 185--192. https://doi.org/10.1145/2700648.2809853 Google Scholar
Digital Library
- Nigel Harris. 2017. The Design and Development of Assistive Technology. IEEE Potentials , Vol. 36, 1 (2017), 24--28. https://doi.org/10.1109/MPOT.2016.2615107Google Scholar
Cross Ref
- Mario Heinz, Sebastian Büttner, and Carsten Röcker. 2020. Exploring Users' Eye Movements When Using Projection-Based Assembly Assistive Systems. In International Conference on Human-Computer Interaction. Springer, 259--272.Google Scholar
- Catherine Holloway. 2019. Disability Interaction (DIX): A Manifesto. Interactions , Vol. 26, 2 (Feb. 2019), 44--49. https://doi.org/10.1145/3310322 Google Scholar
Digital Library
- Oliver Korn, Markus Funk, and Albrecht Schmidt. 2015a. Design Approaches for the Gamification of Production Environments: A Study Focusing on Acceptance. In Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments (Corfu, Greece) (PETRA '15). Association for Computing Machinery, New York, NY, USA, Article 6, bibinfonumpages7 pages. https://doi.org/10.1145/2769493.2769549 Google Scholar
Digital Library
- Oliver Korn, Markus Funk, and Albrecht Schmidt. 2015b. Towards a Gamification of Industrial Production: A Comparative Study in Sheltered Work Environments. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (Duisburg, Germany) (EICS '15). Association for Computing Machinery, New York, NY, USA, 84--93. https://doi.org/10.1145/2774225.2774834 Google Scholar
Digital Library
- Oliver Korn, Johannes Lang, Andreas Korge, Haris Causegic, and Albrecht Schmidt. 2016. Gamification of a Workday: A Study on the Effects in Sheltered Employment. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA '16). Association for Computing Machinery, New York, NY, USA, 3114--3121. https://doi.org/10.1145/2851581.2892283 Google Scholar
Digital Library
- Oliver Korn, Albrecht Schmidt, and Thomas Hörz. 2013a. Augmented Manufacturing: A Study with Impaired Persons on Assistive Systems Using in-Situ Projection. In Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments (Rhodes, Greece) (PETRA '13). Association for Computing Machinery, New York, NY, USA, Article 21, bibinfonumpages8 pages. https://doi.org/10.1145/2504335.2504356 Google Scholar
Digital Library
- Oliver Korn, Albrecht Schmidt, and Thomas Hörz. 2013b. The Potentials of In-Situ-Projection for Augmented Workplaces in Production: A Study with Impaired Persons. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (Paris, France) (CHI EA '13). Association for Computing Machinery, New York, NY, USA, 979--984. https://doi.org/10.1145/2468356.2468531 Google Scholar
Digital Library
- Thomas Kosch, Romina Kettner, Markus Funk, and Albrecht Schmidt. 2016. Comparing Tactile, Auditory, and Visual Assembly Error-Feedback for Workers with Cognitive Impairments. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility (Reno, Nevada, USA) (ASSETS '16). Association for Computing Machinery, New York, NY, USA, 53--60. https://doi.org/10.1145/2982142.2982157 Google Scholar
Digital Library
- FJ Meiland, BJ Hattink, T Overmars-Marx, ME De Boer, A Jedlitschka, PW Ebben, II Stalpers-Croeze, S Flick, J Van der Leeuw, IP Karkowski, et almbox. 2014. Participation of end users in the design of assistive technology for people with mild to severe cognitive problems; the European Rosetta project. Int Psychogeriatr , Vol. 26, 5 (2014), 769--779.Google Scholar
Cross Ref
- Henrik Mucha, Sebastian Büttner, and Carsten Röcker. 2016. Application Areas for Human-Centered Assistive Systems. In Human-Computer Interaction--Perspectives on Industry 4.0. Workshop at i-KNOW 2016 Graz, Austria, Oct 2016 .Google Scholar
- Timothy Neate, Aikaterini Bourazeri, Abi Roper, Simone Stumpf, and Stephanie Wilson. 2019. Co-Created Personas: Engaging and Empowering Users with Diverse Needs Within the Design Process. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3290605.3300880 Google Scholar
Digital Library
- rexroth -- a Bosch Company. 2019. ActiveAssist assistance system -- modular, connected, interactive . https://www.boschrexroth.com/en/xc/products/product-groups/assembly-technology/news/activeassist-assistance-system/index .Google Scholar
- Carsten Röcker and Sebastian Robert. 2016. Projektionsbasierte Montageunterstützung mit visueller Fortschrittserkennung [German]. visIT Industrie , Vol. 4 (2016).Google Scholar
- Kasper Rodil, Emil Byskov Nielsen, and Jonathan Bernstorff Nielsen. 2018. Sharing memories: Co-designing assistive technology with aphasic adults and support staff. International Journal of Sociotechnology and Knowledge Development (IJSKD) , Vol. 10, 1 (2018), 21--36. Google Scholar
Digital Library
- Oliver Sand, Sebastian Büttner, Volker Paelke, and Carsten Röcker. 2016. smARt. Assembly--projection-based augmented reality for supporting assembly workers. In International Conference on Virtual, Augmented and Mixed Reality. Springer, 643--652.Google Scholar
Cross Ref
- Orad Weisberg, Ayelet GalOz, Ruth Berkowitz, Noa Weiss, Oran Peretz, Shlomi Azoulai, Daphne KoplemanRubin, and Oren Zuckerman. 2014. TangiPlan: designing an assistive technology to enhance executive functioning among children with ADHD. In Proceedings of the 2014 conference on Interaction design and children. 293--296. Google Scholar
Digital Library
- Jacob O Wobbrock, Krzysztof Z Gajos, Shaun K Kane, and Gregg C Vanderheiden. 2018. Ability-based design. Commun. ACM , Vol. 61, 6 (2018), 62--71. Google Scholar
Digital Library
Index Terms
(auto-classified)Dynamic Task Allocation based on Individual Abilities - Experiences from Developing and Operating an Inclusive Assembly Line for Workers With and Without Disabilities
Recommendations
Augmented Reality Training for Industrial Assembly Work - Are Projection-based AR Assistive Systems an Appropriate Tool for Assembly Training?
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsAugmented Reality (AR) systems are on their way to industrial application, e.g. projection-based AR is used to enhance assembly work. Previous studies showed advantages of the systems in permanent-use scenarios, such as faster assembly times. In this ...
Using Head-Mounted Displays and In-Situ Projection for Assistive Systems: A Comparison
PETRA '16: Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive EnvironmentsThe increasing demand to customize products affects production workers in many industries, as assembly tasks become more complex due to higher product variety. Assistive systems providing instructions at the workplace have been proposed to overcome ...
Using In-Situ Projection to Support Cognitively Impaired Workers at the Workplace
ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & AccessibilityToday's working society tries to integrate more and more impaired workers into everyday working processes. One major scenario for integrating impaired workers is in the assembly of products. However, the tasks that are being assigned to cognitively ...






Comments