Space utilization and activity recognition using 3D stereo vision camera inside an educational building

ABSTRACT

Accurate occupancy information is imperative for the optimization of built-in environments to achieve energy savings and user comfort. Comprehending the occupancy information provides an opportunity to interpret movement patterns, circulation-flow, space usage patterns inside the building. In this paper, we designed a case study that includes experimental testbeds from the HL Linder Hall Cafeteria; a public shared space at the University of Cincinnati College of Business, United States. Based on the time-series data collected from 3D Stereo Vision Camera, an algorithm is proposed for the removal of redundant occupant IDs to overcome inconsistencies in the Field of View (FoV) of the camera and ensure accurate estimates and consistent data. Another algorithm for data annotation in activity recognition is proposed for the binary class classification of activity with sitting and moving labels. The data obtained can be used for inspecting various types of open and shared spaces available for work and quotidian interactions among occupants. The seats and space utilization patterns extracted from the camera within the monitored area are validated using a digitally advanced tool, known as ArcGIS Pro. For the experiment, prior permission was granted by the Building Management System (BMS) authorities, and occupants' confidentiality is preserved. The space usage patterns extracted can grant access to the new dimension of investigation associated with the space selection and occupant behavior inside the buildings. This paper also discusses the challenges faced during the design phase for the deployment, and it summarizes the potential improvements in the field of occupancy sensing for energy-efficient buildings.

References

1. [n.d.]. PC2 | Xovis. https://www.xovis.com/products/detail/pc2/. (Accessed on 02/01/2020).
2. Seung Hyun Cha, Koen Steemers, and Tae Wan Kim. 2018. Modeling space preferences for accurate occupancy prediction during the design phase. Automation in Construction 93 (2018), 135--147.
3. Anooshmita Das, Emil Stubbe Kolvig Raun, and Mikkel Baun Kjærgaard. 2019. CAM-STITCH: Trajectory Cavity Stitching Method for Stereo Vision Cameras in a Public Building. In Proceedings of the First International Workshop on Challenges in Artificial Intelligence and Machine Learning for Internet of Things. ACM, 8--14.
4. Anooshmita Das, Fisayo Caleb Sangogboye, and Mikkel Baun Kjærgaard. 2018. Mapping the important sensor limitations to design robust occupant sensing systems. In UbiComp'18. ACM, 1156--1161.
5. Anooshmita Das, Fisayo Caleb Sangogboye, Emil Stubbe Kolvig Raun, and Mikkel Baun Kjærgaard. 2019. HeteroSense: An Occupancy Sensing Framework for Multi-Class Classification for Activity Recognition and Trajectory Detection. In SocialSense'19. ACM, 12--17.
6. Bing Dong and Khee Poh Lam. 2011. Building energy and comfort management through occupant behaviour pattern detection based on a large-scale environmental sensor network. Journal of Building Performance Simulation 4, 4 (2011), 359--369.
7. European Parliament and Council of the European Union. 2016. Regulations (EU) 2016/679 of the European Parliament and of the Council - General Data Protection Regulation (GDPR). Official Journal of the European Union L119 (May 2016), 1--88. https://eur-lex.europa.eu/eli/reg/2016/679/oj
8. William J Fisk, David Faulkner, and Douglas P Sullivan. 2006. Accuracy of CO2 sensors in commercial buildings: a pilot study. (2006).
9. H Burak Gunay, Anthony Fuller, William O'Brien, and Ian Beausoleil-Morrison. 2016. Detecting occupants' presence in office spaces: a case study. eSim 2016, Hamilton, ON (2016).
10. Shian-Ru Ke, Hoang Thuc, Yong-Jin Lee, Jenq-Neng Hwang, Jang-Hee Yoo, and Kyoung-Ho Choi. 2013. A review on video-based human activity recognition. Computers 2, 2 (2013), 88--131.
11. Mikkel Baun Kjærgaard, Martin Werner, Fisayo Caleb Sangogboye, and Krzysztof Arendt. 2018. Dcount-a probabilistic algorithm for accurately disaggregating building occupant counts into room counts. In 2018 19th IEEE International Conference on Mobile Data Management (MDM). IEEE, 46--55.
12. Jeremy Michalek, Ruchi Choudhary, and Panos Papalambros. 2002. Architectural layout design optimization. Engineering optimization 34, 5 (2002), 461--484.
13. William M Rand. 1971. Objective criteria for the evaluation of clustering methods. Journal of the American Statistical association 66, 336 (1971), 846--850.
14. Rajkumar Saini, Pradeep Kumar, Partha Pratim Roy, and Debi Prosad Dogra. 2018. A novel framework of continuous human-activity recognition using kinect. Neurocomputing 311 (2018), 99--111.
15. Fisayo Caleb Sangoboye and Mikkel Baun Kjærgaard. 2016. Plcount: A probabilistic fusion algorithm for accurately estimating occupancy from 3d camera counts. In Proceedings of the 3rd ACM International Conference on Systems for Energy-Efficient Built Environments. 147--156.
16. Fisayo Caleb Sangogboye. 2018. Data-Driven Methods for Occupant Sensing and Privacy Protection: With Applications to Enable Smart and Energy Efficient Buildings. Ph.D. Dissertation. University of Southern Denmark.
17. Shaufikah Shukri and Latifah Munirah Kamarudin. 2017. Device free localization technology for human detection and counting with RF sensor networks: A review. Journal of Network and Computer Applications 97 (2017), 157--174.
18. Thomas Wortmann. 2017. Model-based Optimization for Architectural Design: Optimizing Daylight and Glare in Grasshopper. Technology| Architecture+ Design 1, 2 (2017), 176--185.
19. Da Yan, Tianzhen Hong, Bing Dong, Ardeshir Mahdavi, Simona D'Oca, Isabella Gaetani, and Xiaohang Feng. 2017. IEA EBC Annex 66: Definition and simulation of occupant behavior in buildings. Energy and Buildings 156 (2017), 258--270.

Index Terms

• Computer systems organization

  • Embedded and cyber-physical systems

    • Sensor networks

• Computing methodologies

  • Machine learning

• General and reference

  • Cross-computing tools and techniques

    • Design

    • Evaluation

    • Reliability

• Hardware

  • Communication hardware, interfaces and storage

    • Sensor applications and deployments

    • Sensor devices and platforms

• Human-centered computing

  • Interaction design

    • Interaction design process and methods

      • Activity centered design

      • Scenario-based design