Abstract
Human activity recognition using embedded mobile and embedded sensors is becoming increasingly important. Scaling up from individuals to groups, that is, Group Activity Recognition (GAR), has attracted significant attention recently. This article proposes a model and modeling language for GAR called GroupSense-L and a novel distributed middleware called GroupSense for mobile GAR. We implemented and tested GroupSense using smartphone sensors, smartwatch sensors, and embedded sensors in things, where we have a protocol for these different devices to exchange information required for GAR. A range of continuous group activities (from simple to fairly complex) illustrates our approach and demonstrates the feasibility of our model and richness of the proposed specialization. We then conclude with lessons learned for GAR and future work.
- Android Developers. Sending and Syncing Data. 2016. Retrieved December 8, 2018 from https://developer.android.com/training/wearables/data-layer/index.html. (07 2016). (Accessed on 08/07/2016).Google Scholar
- Amin B. Abkenar, Seng W. Loke, Wenny Rahayu, and Arkady Zaslavsky. 2016. Energy considerations for continuous group activity recognition using mobile devices: The case of GroupSense. In IEEE 30th International Conference on Advanced Information Networking and Applications (AINA’16). IEEE, 479--486.Google Scholar
Cross Ref
- James F. Allen. 1983. Maintaining knowledge about temporal intervals. Communications of the ACM 26, 11 (1983), 832--843. Google Scholar
Digital Library
- L. Atallah, B. Lo, R. King, and G. Z. Yang. 2011. Sensor positioning for activity recognition using wearable accelerometers. IEEE Transactions on Biomedical Circuits and Systems 5, 4 (Aug 2011), 320--329.Google Scholar
Cross Ref
- A. BakhshandehAbkenar and S. W. Loke. 2014. MyActivity: Cloud-hosted continuous activity recognition using ontology-based stream reasoning. In 2nd IEEE International Conference on Mobile Cloud Computing, Services, and Engineering. 117--126. Google Scholar
Digital Library
- Anja Bekkelien, Michel Deriaz, and Stéphane Marchand-Maillet. 2012. Bluetooth indoor positioning. Master’s Thesis, University of Geneva (2012), Geneva, Switzerland.Google Scholar
- A. L. Bourbia, H. Son, B. Shin, T. Kim, D. Lee, and S. J. Hyun. 2016. Temporal dependency rule learning based group activity recognition in smart spaces. In IEEE 40th Annual Computer Software and Applications Conference (COMPSAC’16), Vol. 1. IEEE, 658--663.Google Scholar
- Liming Chen and Chris Nugent. 2009. Ontology-based activity recognition in intelligent pervasive environments. International Journal of Web Information Systems 5, 4 (2009), 410--430.Google Scholar
Cross Ref
- Jung-In Choi and Hwan-Seung Yong. 2015. Conceptual group activity recognition model for classroom environments. In International Conference on Information and Communication Technology Convergence (ICTC’15). IEEE, 658--661.Google Scholar
Cross Ref
- M. Davari and H. Amintoosi. 2016. A survey on participant recruitment in crowdsensing systems. In 6th International Conference on Computer and Knowledge Engineering (ICCKE). IEEE, 286--291.Google Scholar
- R. K. Ganti, F. Ye, and H. Lei. 2011. Mobile crowdsensing: Current state and future challenges. IEEE Communications Magazine 49, 11 (November 2011), 32--39.Google Scholar
Cross Ref
- Dawud Gordon, Jürgen Czerny, and Michael Beigl. 2014. Activity recognition for creatures of habit. Personal Ubiquitous Computing 18, 1 (Jan. 2014), 205--221. Google Scholar
Digital Library
- Dawud Gordon, Jan-Hendrik Hanne, Martin Berchtold, Ali Asghar Nazari Shirehjini, and Michael Beigl. 2013. Towards collaborative group activity recognition using mobile devices. Mobile Networks and Applications 18, 3 (2013), 326--340. Google Scholar
Digital Library
- Dawud Gordon, Martin Wirz, Daniel Roggen, Gerhard Tröster, and Michael Beigl. 2014. Group affiliation detection using model divergence for wearable devices. In Proceedings of the ACM International Symposium on Wearable Computers (ISWC’14). ACM, New York, NY, 19--26. Google Scholar
Digital Library
- Raffaele Gravina, Congcong Ma, Pasquale Pace, Gianluca Aloi, Wilma Russo, Wenfeng Li, and Giancarlo Fortino. 2017. Cloud-based activity-aaService cyber--physical framework for human activity monitoring in mobility. Future Generation Computer Systems 75 (2017), 158--171.Google Scholar
Cross Ref
- John J. Guiry, Pepijn van de Ven, and John Nelson. 2014. Multi-sensor fusion for enhanced contextual awareness of everyday activities with ubiquitous devices. Sensors 14, 3 (2014), 5687--5701.Google Scholar
Cross Ref
- Tomoya Hirano and Takuya Maekawa. 2013. A hybrid unsupervised/supervised model for group activity recognition. In Proceedings of the 2International Symposium on Wearable Computers. ACM, 21--24. Google Scholar
Digital Library
- Ozlem Durmaz Incel, Mustafa Kose, and Cem Ersoy. 2013. A review and taxonomy of activity recognition on mobile phones. BioNanoScience 3, 2 (2013), 145--171.Google Scholar
Cross Ref
- L. G. Jaimes, I. J. Vergara-Laurens, and A. Raij. 2015. A survey of incentive techniques for mobile crowd sensing. IEEE Internet of Things Journal 2, 5 (Oct 2015), 370--380.Google Scholar
- An Jian, Gui Xiaolin, Yang Jianwei, Sun Yu, and He Xin. 2015. Mobile crowd sensing for Internet of Things: A credible crowdsourcing model in mobile-sense service. In IEEE International Conference on Multimedia Big Data (BigMM). IEEE, 92--99. Google Scholar
Digital Library
- Oscar D. Lara and Miguel A. Labrador. 2013. A survey on human activity recognition using wearable sensors. IEEE Communications Surveys and Tutorials 15, 3 (2013), 1192--1209.Google Scholar
Cross Ref
- Martin Liggins II, David Hall, and James Llinas. 2017. Handbook of Multisensor Data Fusion: Theory and Practice. CRC Press.Google Scholar
- Huan Liu and Hiroshi Motoda. 1998. Feature Extraction, Construction and Selection: A Data Mining Perspective. Vol. 453. Springer Science 8 Business Media. Google Scholar
Digital Library
- Jinwei Liu, Haiying Shen, and Xiang Zhang. 2016. A survey of mobile crowdsensing techniques: A critical component for the Internet ofThings. In 25th International Conference on Computer Communication and Networks (ICCCN). IEEE, 1--6.Google Scholar
Cross Ref
- Ching-Hu Lu and Yi-Ting Chiang. 2014. Interaction-feature enhanced multiuser model learning for a home environment using ambient sensors. International Journal of Intelligent Systems 29, 11 (2014), 1015--1046. Google Scholar
Digital Library
- Rainer Mautz. 2012. Indoor positioning technologies. PhD thesis, Habil. ETH Zürich.Google Scholar
- Greg Milette and Adam Stroud. 2012. Professional Android Sensor Programming. John Wiley 8 Sons. Google Scholar
Digital Library
- S. C. Mukhopadhyay. 2015. Wearable sensors for human activity monitoring: A review. IEEE Sensors Journal 15, 3 (March 2015), 1321--1330.Google Scholar
Cross Ref
- Charith Perera, Arkady Zaslavsky, Peter Christen, and Dimitrios Georgakopoulos. 2014. Context aware computing for theInternet of Things: A survey. IEEE Communications Surveys 8 Tutorials 16, 1 (2014), 414--454.Google Scholar
- Daniel Roggen, Martin Wirz, Gerhard Tröster, and Dirk Helbing. 2011. Recognition of crowd behavior from mobile sensors with pattern analysis and graph clustering methods. arXiv preprint arXiv:1109.1664 (2011).Google Scholar
- Saguna Saguna, Arkady Zaslavsky, and Dipanjan Chakraborty. 2013. Complex activity recognition using context-driven activity theory and activity signatures. ACM Transactions on Computer-Human Interaction 20, 6 (2013), 32. Google Scholar
Digital Library
- Mahadev Satyanarayanan, Pieter Simoens, Yu Xiao, Padmanabhan Pillai, Zhuo Chen, Kiryong Ha, Wenlu Hu, and Brandon Amos. 2015. Edge analytics in the Internet of Things. IEEE Pervasive Computing 14, 2 (2015), 24--31.Google Scholar
Digital Library
- Roger S. Scowen. 1998. Extended BNF-a Generic Base Standard. Technical Report. ISO/IEC 14977. http://www.cl.cam.ac.uk/mgk25/iso-14977.pdf.Google Scholar
- Sougata Sen, Vigneshwaran Subbaraju, Archan Misra, Rajesh Krishna Balan, and Youngki Lee. 2015. The case for smartwatch-based diet monitoring. In IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops). IEEE, 585--590.Google Scholar
Cross Ref
- M. Shoaib, S. Bosch, H. Scholten, P. J. M. Havinga, and O. D. Incel. 2015. Towards detection of bad habits by fusing smartphone and smartwatch sensors. In IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops). IEEE, 591--596.Google Scholar
- Amir Shirkhodaie and Vinayak Elangovan. 2014. Knowledge discovery in group activities through sequential observation analysis. In Proceedings of the Signal Processing (SPIE'14), Vol. 9091.Google Scholar
- Gary M. Weiss and Jeffrey W. Lockhart. 2012. The impact of personalization on smartphone-based activity recognition. In AAAI Workshop on Activity Context Representation: Techniques and Languages. AAAI Technical Report WS--12--05. 98--104.Google Scholar
- YouTube. 2010. Cherry picking Australia by math. (2010). Retrieved October 27, 2016 from https://www.youtube.com/watch?v=bzn1F7GW9I4.Google Scholar
- Na Yu, Yongjian Zhao, Qi Han, Weiping Zhu, and Hejun Wu. 2016. Identification of partitions in a homogeneous activity group using mobile devices. Mobile Information Systems 2016 (2016), 1--14.Google Scholar
Cross Ref
- X. Zhang, Z. Yang, W. Sun, Y. Liu, S. Tang, K. Xing, and X. Mao. 2016. Incentives for mobile crowd sensing: A survey. IEEE Communications Surveys Tutorials 18, 1 (First Quarter 2016), 54--67.Google Scholar
Digital Library
Index Terms
GroupSense: Recognizing and Understanding Group Physical Activities using Multi-Device Embedded Sensing
Recommendations
A Comprehensive Review of Group Activity Recognition in Videos
AbstractHuman group activity recognition (GAR) has attracted significant attention from computer vision researchers due to its wide practical applications in security surveillance, social role understanding and sports video analysis. In this paper, we ...
Wearable Sensor Badge and Sensor Jacket for Context Awareness
ISWC '99: Proceedings of the 3rd IEEE International Symposium on Wearable ComputersThe addition of sensors to wearable computers allows them to adapt their functions to more suit the activities and situation of their wearers. Here a wearable sensor badge is described constructed from (hard) electronic components, which can sense ...
Maisons Vill'Âge®: Smart use of home automation for healthy aging
ICOST'11: Proceedings of the 9th international conference on Toward useful services for elderly and people with disabilities: smart homes and health telematicsAs part of a PhD thesis at the Loria research center, National Polytechnic Institute of Lorraine (INPL), "Maisons Vill'âge®" a new concept of building smart home by integrating telehealthcare and home automation systems, is developed in France. The ...






Comments