Abstract

Coronavirus is thought to spread through close contact from person to person. While it is believed that the primary means of spread is by inhaling respiratory droplets or aersols, it may also be spread by touching inanimate objects such as doorknobs and handrails that have the virus on it ("fomites''). The Centers for Disease Control and Prevention (CDC) therefore recommends individuals maintain "social distance'' of more than six feet between one another. It further notes that an individual may be infected by touching a fomite and then touching their own mouth, nose or possibly their eyes. We propose the use of computer vision techniques to combat the spread of coronavirus by sounding an audible alarm when an individual touches their own face, or when multiple individuals come within six feet of one another or shake hands. We further propose using depth cameras to track where people touch parts of their physical environment throughout the day, and a simple model of disease spread among potential fomites. Projection mapping techniques can be used to display likely fomites in realtime, while headworn augmented reality systems can be used by custodial staff to perform more effective cleaning of surfaces. Such techniques may find application in particularly vulnerable settings such as schools, long-term care facilities and physician offices.
Supplemental Material
- Arduino Team. 2020. This pair of Arduino glasses stops you from touching your face. https://blog.arduino.cc/2020/03/ 10/this-pair-of-arduino-glasses-stops-you-from-touching-your-face/. Proc. ACM Hum.-Comput. Interact., Vol. 4, No. ISS, Article 203. Publication date: November 2020. 203:12 Andrew D. WilsonGoogle Scholar
- Z. Cao, G. Hidalgo Martinez, T. Simon, S. Wei, and Y. A. Sheikh. 2019. OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. IEEE Transactions on Pattern Analysis and Machine Intelligence (2019).Google Scholar
- Centers for Disease Control and Prevention. 2020. CDC updates COVID-19 transmission webpage to clarify information about types of spread. https://www.cdc.gov/media/releases/2020/s0522-cdc-updates-covid-transmission.html.Google Scholar
- Centers for Disease Control and Prevention. 2020. How COVID-19 Spreads. https://www.cdc.gov/coronavirus/2019- ncov/prevent-getting-sick/how-covid-spreads.html.Google Scholar
- Xiang 'Anthony' Chen. 2020. FaceOff: Detecting Face Touching with a Wrist-Worn Accelerometer. arXiv:2008.01769 [cs.HC]Google Scholar
- Zhen-Dong Guo, Zhong-Yi Wang, Shou-Feng Zhang, Xiao Li, Lin Li, Chao Li, Yan Cui, Rui-Bin Fu, Yun-Zhu Dong, Xiang-Yang Chi, et al. 2020. Aerosol and surface distribution of severe acute respiratory syndrome coronavirus 2 in hospital wards, Wuhan, China, 2020. Emerg Infect Dis 26, 7 (2020).Google Scholar
- Otmar Hilliges, David Kim, Shahram Izadi, Malte Weiss, and Andrew Wilson. 2012. HoloDesk: Direct 3d Interactions with a Situated See-through Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). Association for Computing Machinery, New York, NY, USA, 2421--2430. https: //doi.org/10.1145/2207676.2208405Google Scholar
Digital Library
- Shahram Izadi, Richard A. Newcombe, David Kim, Otmar Hilliges, David Molyneaux, Steve Hodges, Pushmeet Kohli, Jamie Shotton, Andrew J. Davison, and Andrew Fitzgibbon. 2011. KinectFusion: Real-Time Dynamic 3D Surface Reconstruction and Interaction. In ACM SIGGRAPH 2011 Talks (Vancouver, British Columbia, Canada) (SIGGRAPH '11). Association for Computing Machinery, NewYork, NY, USA, Article 23, 1 pages. https://doi.org/10.1145/2037826.2037857Google Scholar
Digital Library
- Brett Jones, Rajinder Sodhi, Michael Murdock, Ravish Mehra, Hrvoje Benko, AndrewWilson, Eyal Ofek, Blair MacIntyre, Nikunj Raghuvanshi, and Lior Shapira. 2014. RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector- Camera Units. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST '14). Association for Computing Machinery, New York, NY, USA, 637--644. https://doi.org/10. 1145/2642918.2647383Google Scholar
Digital Library
- Alicia NM Kraay, Michael AL Hayashi, Nancy Hernandez-Ceron, Ian H Spicknall, Marisa C Eisenberg, Rafael Meza, and Joseph NS Eisenberg. 2018. Fomite-mediated transmission as a sufficient pathway: a comparative analysis across three viral pathogens. BMC infectious diseases 18, 1 (2018), 540.Google Scholar
- Mary Y. Y. Lai, Peter K. C. Cheng, and Wilina W. L. Lim. 2005. Survival of Severe Acute Respiratory Syndrome Coronavirus. Clinical Infectious Diseases 41, 7 (10 2005), e67--e71. https://doi.org/10.1086/433186 arXiv:https://academic.oup.com/cid/article-pdf/41/7/e67/881171/41--7-e67.pdfGoogle Scholar
- David Lindlbauer and Andy D. Wilson. 2018. Remixed Reality: Manipulating Space and Time in Augmented Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, Article 129, 13 pages. https://doi.org/10.1145/3173574. 3173703Google Scholar
- Nicolai Marquardt, Robert Diaz-Marino, Sebastian Boring, and Saul Greenberg. 2011. The Proximity Toolkit: Prototyping Proxemic Interactions in Ubiquitous Computing Ecologies. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST '11). Association for Computing Machinery, New York, NY, USA, 315--326. https://doi.org/10.1145/2047196.2047238Google Scholar
Digital Library
- Microsoft. 2020. About Azure Kinect Sensor SDK. https://docs.microsoft.com/en-us/azure/kinect-dk/about-sensor-sdk.Google Scholar
- Microsoft. 2020. Azure Kinect DK. https://azure.microsoft.com/en-us/services/kinect-dk/.Google Scholar
- Microsoft. 2020. Quickstart: Set up Azure Kinect body tracking. https://docs.microsoft.com/en-us/azure/kinectdk/ body-sdk-setup.Google Scholar
- Microsoft Research. 2015. RoomAlive Toolkit. https://github.com/Microsoft/RoomAliveToolkit.Google Scholar
- Brian Moore Mike Bodge and Isaac Blankensmith. 2020. https://donottouchyourface.com/.Google Scholar
- MIT Media Lab. 2020. Project Saving Face. https://www.media.mit.edu/projects/saving-face/overview/.Google Scholar
- New York Times. 2020. This 3-D Simulation Shows Why Social Distancing Is So Important. https://www.nytimes. com/interactive/2020/04/14/science/coronavirus-transmission-cough-6-feet-ar-ul.html.Google Scholar
- New York Times. 2020. What's the Risk of Catching Coronavirus From a Surface? https://www.nytimes.com/2020/05/ 28/well/live/whats-the-risk-of-catching-coronavirus-from-a-surface.html.Google Scholar
- Mark Nicas and Daniel Best. 2008. A Study Quantifying the Hand-to-Face Contact Rate and Its Potential Application to Predicting Respiratory Tract Infection. Journal of Occupational and Environmental Hygiene 5, 6 (2008), 347--352. https://doi.org/10.1080/15459620802003896 arXiv:https://doi.org/10.1080/15459620802003896 PMID: 18357546.Google Scholar
- Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L. Davidson, Sameh Khamis, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A. Chou, Sarah Mennicken, Julien Valentin, Vivek Pradeep, Shenlong Wang, Sing Bing Kang, Pushmeet Kohli, Yuliya Lutchyn, Cem Keskin, and Shahram Izadi. 2016. Holoportation: Virtual 3D Teleportation in Real-Time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST '16). Association for Computing Proc. ACM Hum.-Comput. Interact., Vol. 4, No. ISS, Article 203. Publication date: November 2020. Combating the Spread of Coronavirus by Modeling Fomites with Depth Cameras 203:13 Machinery, New York, NY, USA, 741--754. https://doi.org/10.1145/2984511.2984517Google Scholar
Digital Library
- Mark Rober. 2020. How To See Germs Spread (Coronavirus). https://www.youtube.com/watch?v=I5-dI74zxPg.Google Scholar
- Jamie Shotton, Toby Sharp, Alex Kipman, Andrew Fitzgibbon, Mark Finocchio, Andrew Blake, Mat Cook, and Richard Moore. 2013. Real-Time Human Pose Recognition in Parts from Single Depth Images. Commun. ACM 56, 1 (Jan. 2013), 116--124. https://doi.org/10.1145/2398356.2398381Google Scholar
Digital Library
- TechCrunch. 2020. Immutouch wristband buzzed to stop touching your face. https://techcrunch.com/2020/03/09/dontimmutouch/.Google Scholar
- Neeltje van Doremalen, Trenton Bushmaker, Dylan H. Morris, Myndi G. Holbrook, Amandine Gamble, Brandi N. Williamson, Azaibi Tamin, Jennifer L. Harcourt, Natalie J. Thornburg, Susan I. Gerber, James O. Lloyd-Smith, Emmie de Wit, and Vincent J. Munster. 2020. Aerosol and Surface Stability of SARS-CoV-2 as Compared with SARS-CoV-1. New England Journal of Medicine 382, 16 (2020), 1564--1567. https://doi.org/10.1056/NEJMc2004973 arXiv:https://doi.org/10.1056/NEJMc2004973Google Scholar
Cross Ref
- Washington Post. 2020. Officials keep warning the public not to touch their faces -- and then do just that. https: //www.youtube.com/watch?v=mA1wqjaeKj0.Google Scholar
- Andrew Wilson, Hrvoje Benko, Shahram Izadi, and Otmar Hilliges. 2012. Steerable Augmented Reality with the Beamatron. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST '12). Association for Computing Machinery, New York, NY, USA, 413--422. https://doi.org/ 10.1145/2380116.2380169Google Scholar
Digital Library
- Andrew D. Wilson. 2010. Using a Depth Camera as a Touch Sensor. In ACM International Conference on Interactive Tabletops and Surfaces (Saarbrücken, Germany) (ITS '10). Association for Computing Machinery, New York, NY, USA, 69--72. https://doi.org/10.1145/1936652.1936665Google Scholar
Digital Library
- Andrew D. Wilson. 2017. Fast Lossless Depth Image Compression. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (Brighton, United Kingdom) (ISS '17). Association for Computing Machinery, New York, NY, USA, 100--105. https://doi.org/10.1145/3132272.3134144Google Scholar
Digital Library
- Andrew D. Wilson and Hrvoje Benko. 2010. Combining Multiple Depth Cameras and Projectors for Interactions on, above and between Surfaces. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (New York, New York, USA) (UIST '10). Association for Computing Machinery, New York, NY, USA, 273--282. https://doi.org/10.1145/1866029.1866073Google Scholar
- Chi-Jui Wu, Steven Houben, and Nicolai Marquardt. 2017. EagleSense: Tracking People and Devices in Interactive Spaces Using Real-Time Top-View Depth-Sensing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 3929--3942. https://doi.org/10.1145/3025453.3025562Google Scholar
Digital Library
- Robert Xiao, Scott Hudson, and Chris Harrison. 2016. DIRECT: Making Touch Tracking on Ordinary Surfaces Practical with Hybrid Depth-Infrared Sensing. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (Niagara Falls, Ontario, Canada) (ISS '16). Association for Computing Machinery, New York, NY, USA, 85--94. https://doi.org/10.1145/2992154.2992173Google Scholar
Digital Library
- Jijun Zhao, Joseph E Eisenberg, Ian H Spicknall, Sheng Li, and James S Koopman. 2012. Model analysis of fomite mediated influenza transmission. PloS one 7, 12 (2012).Google Scholar
Index Terms
Combating the Spread of Coronavirus by Modeling Fomites with Depth Cameras
Recommendations
COVID-19 Spread Prediction Model
CONF-CDS 2021: The 2nd International Conference on Computing and Data ScienceIn order to improve the status quo and improve people's awareness of new crown outbreak, quantitatively studied the spread of infectious diseases COVID-19, create conditions for forecast and control the spread of infectious diseases, we according to the ...
A co-infection model on TB - COVID-19 with optimal control and sensitivity analysis
AbstractCOVID-19 had been declared a public health emergency by the World Health Organization in the early 2020. Since then, this deadly virus has claimed millions of lives worldwide. Amidst its chaotic spread, several other diseases have ...
Scalable Telehealth Services to Combat Novel Coronavirus (COVID-19) Pandemic
AbstractAn ongoing pandemic, the novel coronavirus disease 2019 (COVID-19) is threatening the nations of the world regardless of health infrastructure conditions. In the age of digital electronic information and telecommunication technology, scalable ...






Comments