Abstract
Live video computing (LVC) on distributed smart cameras has many important applications; and a database approach based on a Live Video DataBase Management System (LVDBMS) has shown to be effective for general LVC application development. The performance of such a database system relies on accurate interpretation of spatial relationships among objects in the live video. With the popularity of affordable depth cameras, 3D spatial computation techniques have been applied. However, the 3D object models currently used are expensive to compute, and offer limited scalability. We address this drawback in this article by proposing an octree-based 3D spatial logic and presenting algorithms for computing 3D spatial relationships using depth cameras. To support continuous query processing on live video streams, we also develop a GPU-based implementation of the proposed technique to further enhance scalability for real-time applications. Extensive performance studies based on a public RGB-D dataset as well as the LVDBMS prototype demonstrates the correctness and efficiency of our techniques.
- Pradeep Kumar Atrey. 2009. A hierarchical model for representation of events in multimedia observation systems. In Proceedings of the 1st ACM International Workshop on Events in Multimedia. ACM, 57--64. Google Scholar
Digital Library
- Pradeep Kumar Atrey, Mohan S Kankanhalli, and Ramesh Jain. 2006. Information assimilation framework for event detection in multimedia surveillance systems. Multimedia Syst. 12, 3, 239--253. Google Scholar
Digital Library
- A. J. Aved and Kien A. Hua. 2012. A general framework for managing and processing live video data with privacy proctection. Multimedia Syst. 18, 2, 123--143.Google Scholar
Cross Ref
- I. Bloch. 1999. Fuzzy relative position between objects in image processing: a morphological approach. IEEE Trans. Pattern Anal. Mach. Intell. 21, 7, 657--664. Google Scholar
Digital Library
- Isabella Bloch, Olivier Colliot, and Roberto M. Cesar Jr. 2006. On the Ternary Spatial Relation Between. IEEE Trans. Syst. Man Cybern. 36, 2, 312--327. Google Scholar
Digital Library
- André Borrmann, Stefanie Schraufstetter, and Ernst Rank. 2007. An octree-based implementation of directional operators in a 3D spatial query language for building information models. In Proceedings of the 24th CIB-W78 Conference on IT in Construction.Google Scholar
- J. M. Coughlan and A. L. Yuille. 1999. ManhattanWorld: compass direction from a single image by Bayesian inference. In Proceedings of the 7th IEEE International Conference on Computer Vision. 941--947. Google Scholar
Digital Library
- M. A. Fischler and R. C. Bolles. 1981. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 6, 381--395. Google Scholar
Digital Library
- Klaus-Peter Gapp. 1994. From vision to language: A cognitive approach to the computation of spatial relations in 3D space. In Proceedings of the 17th Annual Conference of the Cognitive Science Society.Google Scholar
- Zhaoyin Jia, Andrew Gallagher, Ashutosh Saxena, and Tsuhan Chen. 2013. 3d-based reasoning with blocks, support, and stability. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1--8. Google Scholar
Digital Library
- A. Kasper, R. Jakel, and R. Dillmann. 2011. Using spatial relations of objects in real world scenes for scene structuring and scene understanding. In Proceedings of the 15th International Conference on Advanced Robotics. 421--426.Google Scholar
- J. M. Keller and X.Wang. 1995. Comparison of spatial relation definitions in computer vision. In Proceedings of the 3rd International Symposium on Uncertainty Modeling and Analysis. 679--684. Google Scholar
Digital Library
- J. M. Keller and X. Wang. 1996. Learning spatial relationships in computer vision. In Proceedings of the 5th IEEE International Conference on Fuzzy Systems. 118--124.Google Scholar
- Khronos. 2013. OpenCL. http://www.khronos.org/opencl/. (2013).Google Scholar
- B. J. Kuipers and T. S. Levitt. 1988. Navigation and mapping in large-scale space. AI Mag. 9, 2. Google Scholar
Digital Library
- K. Lai, L. Bo, X. Ren, and D. Fox. 2011. A Large-Scale Hierarchical Multi-View RGBD Object Dataset. In Proceedings of the IEEE International Conference on Robotics and Automation.Google Scholar
- Donald Meagher. 1982. Geometric modeling using octree encoding. Computer Graph. Image Process. 19, 2, 129--147.Google Scholar
Cross Ref
- K. Miyajima and A. Ralescu. 1994. Spatial organization in 2D segmented images: representation and recognition of primitive spatial relations. Fuzzy Sets Syst. 65, 2--3, 225--236. Google Scholar
Digital Library
- R. Peng, A. J. Aved, and K. A. Hua. 2010. Real-time query processing on live videos in networks of distributed cameras. Int. J. Interdisciplinary Telecomm. Netw. 2, 1. Google Scholar
Digital Library
- Abu Saleh Md Mahfujur Rahman, M. Anwar Hossain, and Abdulmotaleb El Saddik. 2010. Spatial-geometric approach to physical mobile interaction based on accelerometer and ir sensory data fusion. ACM Trans. Multimedia Comput. Commun. Appl. 6, 4, 28:1--28:23. Google Scholar
Digital Library
- B. Rosman and S. Ramamoorthy. 2011. Learning spatial relationships between objects. Int. J. Rob. Res. 30, 1, 1328--1342. Google Scholar
Digital Library
- Nadeem Salamat and El-Hadi Zahzah. 2012. On the improvement of combined fuzzy topological and directional relations information. Pattern Recognit. 45, 4, 1559--1568. Google Scholar
Digital Library
- Celina Maki Takemura, Roberto M. Cesar Jr., and Isabelle Bloch. 2012. Modeling and measuring the spatial relation along: regions, contours and fuzzy sets. Pattern Recognit. 45, 2, 757--766. Google Scholar
Digital Library
- Yoshihiro Tashiro. 1977. On methods for generating uniform random points on the surface of a sphere. Ann. Insti. Statistical Math. 29, 1, 295--300.Google Scholar
Cross Ref
- Jun Ye and Kien A. Hua. 2013. Exploiting depth camera for 3D spatial relationship interpretation. In Proceedings of the 4th ACM Multimedia Systems Conference (MMSys'13). 151--161. Google Scholar
Digital Library
- Kiwon Yun, Jean Honorio, Debaleena Chattopadhyay, Tamara L. Berg, and Dimitris Samaras. 2012. Two-person interaction detection using body-pose features and multiple instance learning. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. 28--35.Google Scholar
Cross Ref
Index Terms
Octree-Based 3D Logic and Computation of Spatial Relationships in Live Video Query Processing
Recommendations
Video query processing in the VDBMS testbed for video database research
MMDB '03: Proceedings of the 1st ACM international workshop on Multimedia databasesThe increased use of video data sets for multimedia-based applications has created a demand for strong video database support, including efficient methods for handling the content-based query and retrieval of video data. Video query processing presents ...
Maintaining Spatial Relationships in Uncertain Environments
SASO '12: Proceedings of the 2012 IEEE Sixth International Conference on Self-Adaptive and Self-Organizing SystemsInter-related computations must sometimes maintain spatial relationships as they attempt to individually respond to changes in the environment. These changes may be related to application requirements (as in a sensor network) or resource requirements. ...






Comments