skip to main content
research-article

GroupSense: Recognizing and Understanding Group Physical Activities using Multi-Device Embedded Sensing

Published:09 January 2019Publication History
Skip Abstract Section

Abstract

Human activity recognition using embedded mobile and embedded sensors is becoming increasingly important. Scaling up from individuals to groups, that is, Group Activity Recognition (GAR), has attracted significant attention recently. This article proposes a model and modeling language for GAR called GroupSense-L and a novel distributed middleware called GroupSense for mobile GAR. We implemented and tested GroupSense using smartphone sensors, smartwatch sensors, and embedded sensors in things, where we have a protocol for these different devices to exchange information required for GAR. A range of continuous group activities (from simple to fairly complex) illustrates our approach and demonstrates the feasibility of our model and richness of the proposed specialization. We then conclude with lessons learned for GAR and future work.

References

  1. Android Developers. Sending and Syncing Data. 2016. Retrieved December 8, 2018 from https://developer.android.com/training/wearables/data-layer/index.html. (07 2016). (Accessed on 08/07/2016).Google ScholarGoogle Scholar
  2. Amin B. Abkenar, Seng W. Loke, Wenny Rahayu, and Arkady Zaslavsky. 2016. Energy considerations for continuous group activity recognition using mobile devices: The case of GroupSense. In IEEE 30th International Conference on Advanced Information Networking and Applications (AINA’16). IEEE, 479--486.Google ScholarGoogle ScholarCross RefCross Ref
  3. James F. Allen. 1983. Maintaining knowledge about temporal intervals. Communications of the ACM 26, 11 (1983), 832--843. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. L. Atallah, B. Lo, R. King, and G. Z. Yang. 2011. Sensor positioning for activity recognition using wearable accelerometers. IEEE Transactions on Biomedical Circuits and Systems 5, 4 (Aug 2011), 320--329.Google ScholarGoogle ScholarCross RefCross Ref
  5. A. BakhshandehAbkenar and S. W. Loke. 2014. MyActivity: Cloud-hosted continuous activity recognition using ontology-based stream reasoning. In 2nd IEEE International Conference on Mobile Cloud Computing, Services, and Engineering. 117--126. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Anja Bekkelien, Michel Deriaz, and Stéphane Marchand-Maillet. 2012. Bluetooth indoor positioning. Master’s Thesis, University of Geneva (2012), Geneva, Switzerland.Google ScholarGoogle Scholar
  7. A. L. Bourbia, H. Son, B. Shin, T. Kim, D. Lee, and S. J. Hyun. 2016. Temporal dependency rule learning based group activity recognition in smart spaces. In IEEE 40th Annual Computer Software and Applications Conference (COMPSAC’16), Vol. 1. IEEE, 658--663.Google ScholarGoogle Scholar
  8. Liming Chen and Chris Nugent. 2009. Ontology-based activity recognition in intelligent pervasive environments. International Journal of Web Information Systems 5, 4 (2009), 410--430.Google ScholarGoogle ScholarCross RefCross Ref
  9. Jung-In Choi and Hwan-Seung Yong. 2015. Conceptual group activity recognition model for classroom environments. In International Conference on Information and Communication Technology Convergence (ICTC’15). IEEE, 658--661.Google ScholarGoogle ScholarCross RefCross Ref
  10. M. Davari and H. Amintoosi. 2016. A survey on participant recruitment in crowdsensing systems. In 6th International Conference on Computer and Knowledge Engineering (ICCKE). IEEE, 286--291.Google ScholarGoogle Scholar
  11. R. K. Ganti, F. Ye, and H. Lei. 2011. Mobile crowdsensing: Current state and future challenges. IEEE Communications Magazine 49, 11 (November 2011), 32--39.Google ScholarGoogle ScholarCross RefCross Ref
  12. Dawud Gordon, Jürgen Czerny, and Michael Beigl. 2014. Activity recognition for creatures of habit. Personal Ubiquitous Computing 18, 1 (Jan. 2014), 205--221. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Dawud Gordon, Jan-Hendrik Hanne, Martin Berchtold, Ali Asghar Nazari Shirehjini, and Michael Beigl. 2013. Towards collaborative group activity recognition using mobile devices. Mobile Networks and Applications 18, 3 (2013), 326--340. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Dawud Gordon, Martin Wirz, Daniel Roggen, Gerhard Tröster, and Michael Beigl. 2014. Group affiliation detection using model divergence for wearable devices. In Proceedings of the ACM International Symposium on Wearable Computers (ISWC’14). ACM, New York, NY, 19--26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Raffaele Gravina, Congcong Ma, Pasquale Pace, Gianluca Aloi, Wilma Russo, Wenfeng Li, and Giancarlo Fortino. 2017. Cloud-based activity-aaService cyber--physical framework for human activity monitoring in mobility. Future Generation Computer Systems 75 (2017), 158--171.Google ScholarGoogle ScholarCross RefCross Ref
  16. John J. Guiry, Pepijn van de Ven, and John Nelson. 2014. Multi-sensor fusion for enhanced contextual awareness of everyday activities with ubiquitous devices. Sensors 14, 3 (2014), 5687--5701.Google ScholarGoogle ScholarCross RefCross Ref
  17. Tomoya Hirano and Takuya Maekawa. 2013. A hybrid unsupervised/supervised model for group activity recognition. In Proceedings of the 2International Symposium on Wearable Computers. ACM, 21--24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Ozlem Durmaz Incel, Mustafa Kose, and Cem Ersoy. 2013. A review and taxonomy of activity recognition on mobile phones. BioNanoScience 3, 2 (2013), 145--171.Google ScholarGoogle ScholarCross RefCross Ref
  19. L. G. Jaimes, I. J. Vergara-Laurens, and A. Raij. 2015. A survey of incentive techniques for mobile crowd sensing. IEEE Internet of Things Journal 2, 5 (Oct 2015), 370--380.Google ScholarGoogle Scholar
  20. An Jian, Gui Xiaolin, Yang Jianwei, Sun Yu, and He Xin. 2015. Mobile crowd sensing for Internet of Things: A credible crowdsourcing model in mobile-sense service. In IEEE International Conference on Multimedia Big Data (BigMM). IEEE, 92--99. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Oscar D. Lara and Miguel A. Labrador. 2013. A survey on human activity recognition using wearable sensors. IEEE Communications Surveys and Tutorials 15, 3 (2013), 1192--1209.Google ScholarGoogle ScholarCross RefCross Ref
  22. Martin Liggins II, David Hall, and James Llinas. 2017. Handbook of Multisensor Data Fusion: Theory and Practice. CRC Press.Google ScholarGoogle Scholar
  23. Huan Liu and Hiroshi Motoda. 1998. Feature Extraction, Construction and Selection: A Data Mining Perspective. Vol. 453. Springer Science 8 Business Media. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Jinwei Liu, Haiying Shen, and Xiang Zhang. 2016. A survey of mobile crowdsensing techniques: A critical component for the Internet ofThings. In 25th International Conference on Computer Communication and Networks (ICCCN). IEEE, 1--6.Google ScholarGoogle ScholarCross RefCross Ref
  25. Ching-Hu Lu and Yi-Ting Chiang. 2014. Interaction-feature enhanced multiuser model learning for a home environment using ambient sensors. International Journal of Intelligent Systems 29, 11 (2014), 1015--1046. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Rainer Mautz. 2012. Indoor positioning technologies. PhD thesis, Habil. ETH Zürich.Google ScholarGoogle Scholar
  27. Greg Milette and Adam Stroud. 2012. Professional Android Sensor Programming. John Wiley 8 Sons. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. S. C. Mukhopadhyay. 2015. Wearable sensors for human activity monitoring: A review. IEEE Sensors Journal 15, 3 (March 2015), 1321--1330.Google ScholarGoogle ScholarCross RefCross Ref
  29. Charith Perera, Arkady Zaslavsky, Peter Christen, and Dimitrios Georgakopoulos. 2014. Context aware computing for theInternet of Things: A survey. IEEE Communications Surveys 8 Tutorials 16, 1 (2014), 414--454.Google ScholarGoogle Scholar
  30. Daniel Roggen, Martin Wirz, Gerhard Tröster, and Dirk Helbing. 2011. Recognition of crowd behavior from mobile sensors with pattern analysis and graph clustering methods. arXiv preprint arXiv:1109.1664 (2011).Google ScholarGoogle Scholar
  31. Saguna Saguna, Arkady Zaslavsky, and Dipanjan Chakraborty. 2013. Complex activity recognition using context-driven activity theory and activity signatures. ACM Transactions on Computer-Human Interaction 20, 6 (2013), 32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Mahadev Satyanarayanan, Pieter Simoens, Yu Xiao, Padmanabhan Pillai, Zhuo Chen, Kiryong Ha, Wenlu Hu, and Brandon Amos. 2015. Edge analytics in the Internet of Things. IEEE Pervasive Computing 14, 2 (2015), 24--31.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Roger S. Scowen. 1998. Extended BNF-a Generic Base Standard. Technical Report. ISO/IEC 14977. http://www.cl.cam.ac.uk/mgk25/iso-14977.pdf.Google ScholarGoogle Scholar
  34. Sougata Sen, Vigneshwaran Subbaraju, Archan Misra, Rajesh Krishna Balan, and Youngki Lee. 2015. The case for smartwatch-based diet monitoring. In IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops). IEEE, 585--590.Google ScholarGoogle ScholarCross RefCross Ref
  35. M. Shoaib, S. Bosch, H. Scholten, P. J. M. Havinga, and O. D. Incel. 2015. Towards detection of bad habits by fusing smartphone and smartwatch sensors. In IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops). IEEE, 591--596.Google ScholarGoogle Scholar
  36. Amir Shirkhodaie and Vinayak Elangovan. 2014. Knowledge discovery in group activities through sequential observation analysis. In Proceedings of the Signal Processing (SPIE'14), Vol. 9091.Google ScholarGoogle Scholar
  37. Gary M. Weiss and Jeffrey W. Lockhart. 2012. The impact of personalization on smartphone-based activity recognition. In AAAI Workshop on Activity Context Representation: Techniques and Languages. AAAI Technical Report WS--12--05. 98--104.Google ScholarGoogle Scholar
  38. YouTube. 2010. Cherry picking Australia by math. (2010). Retrieved October 27, 2016 from https://www.youtube.com/watch?v=bzn1F7GW9I4.Google ScholarGoogle Scholar
  39. Na Yu, Yongjian Zhao, Qi Han, Weiping Zhu, and Hejun Wu. 2016. Identification of partitions in a homogeneous activity group using mobile devices. Mobile Information Systems 2016 (2016), 1--14.Google ScholarGoogle ScholarCross RefCross Ref
  40. X. Zhang, Z. Yang, W. Sun, Y. Liu, S. Tang, K. Xing, and X. Mao. 2016. Incentives for mobile crowd sensing: A survey. IEEE Communications Surveys Tutorials 18, 1 (First Quarter 2016), 54--67.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. GroupSense: Recognizing and Understanding Group Physical Activities using Multi-Device Embedded Sensing

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader
          About Cookies On This Site

          We use cookies to ensure that we give you the best experience on our website.

          Learn more

          Got it!