Abstract
With the fast-growing popularity of smart phones in recent years, augmented reality (AR) on mobile devices is gaining more attention and becomes more demanding than ever before. However, the limited processors in mobile devices are not quite promising for AR applications that require real-time processing speed. The challenge exists due to the fact that, while fast features are usually not robust enough in matchings, robust features like SIFT or SURF are not computationally efficient. There is always a tradeoff between robustness and efficiency and it seems that we have to sacrifice one for the other. While this is true for most existing features, researchers have been working on designing new features with both robustness and efficiency. In this article, we are not trying to present a completely new feature. Instead, we propose an efficient matching method for robust features. An adaptive scoring scheme and a more distinctive descriptor are also proposed for performance improvements. Besides, we have developed an outdoor augmented reality system that is based on our proposed methods. The system demonstrates that not only it can achieve robust matchings efficiently, it is also capable to handle large occlusions such as passengers and moving vehicles, which is another challenge for many AR applications.
- Agarwal, S., Snavely, N., Simon, I., Seitz, S., and Szeliski, R. 2009. Building rome in a day. In Proceedings of the International Conference on Computer Vision (ICCV).Google Scholar
- Azad, P., Asfour, T., and Dillmann, R. 2009. Combining harris interest points and the sift descriptor for fast scale-invariant object recognition. In Proceedings of the EEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Google Scholar
Digital Library
- Bay, H., Ess, A., Tuytelaars, T., and Gool, L. V. 2008. Speeded-up robust features (SURF). Comput. Vis. Image Understand. 110, 3, 346--359. Google Scholar
Digital Library
- Boykov, Y. and Huttenlocher, D. 2000. Daptive bayesian recognition in tracking rigid objects. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Cham, T. and Rehg, J. 1999. A multiple hypothesis approach to figure tracking. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Chen, Y., Rui, Y., and Huang, T. 2001. JPDAF-based HMM for real-time contour tracking. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Henze, N., Schinke, T., and Boll, S. 2009. What is that? Object recognition from natural features on a mobile phone. In Proceedings of the Workshop on Mobile Interaction with the Real World.Google Scholar
- Isard, M. and Blake, A. 1998. Condensation-conditional density propagation for visual tracking. Int. J. Comput. Vision 29, 1. Google Scholar
Digital Library
- Kolsch, M. and Turk, M. 2005. Hand tracking with flocks of features. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Google Scholar
Digital Library
- Li, B. and Chellappa, R. 2000. Simultaneous tracking and verification via sequential posterior estimation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Lipton, A., Fujiyoshi, H., and Patil, R. 1998. Moving target classification and tracking from real-time video. In Proceedings of the IEEE Workshop Applications of Computer Vision. Google Scholar
Digital Library
- Lowe, D. 1999. Object recognition from local scaleinvariant features. In Proceedings of the 7th International Conference on Computer Vision (ICCV). Google Scholar
Digital Library
- Rosales, R. and Sclaroff, S. 1999. 3D trajectory recovery for tracking multiple objects and trajectory guided recognition of actions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Se, S., Lowe, D., and Little, J. 2001. Vision-based mobile robot localization and mapping using scale-invariant features. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA). 2051--2058.Google Scholar
- Takacs, G., Chandrasekhar, V., Gelfand, N., Xiong, Y., Chen, W.-C., Bismpigiannis, T., Grzeszczuk, R., Pulli, K., and Girod, B. 2008. Outdoors augmented reality on mobile phone using loxel-based visual feature organization. In Proceedings of the 1st ACM International Conference on Multimedia Information Retrieval (MIR). Google Scholar
Digital Library
- Tamimi, H., Andreasson, H., Treptow, A., Duckett, T., and Zell, A. 2005. Localization of mobile robots with omnidirectional vision using particle filter and iterative sift. In Proceedings of the European Conference on Mobile Robots (ECMR).Google Scholar
- Wagner, D., Reitmayr, G., Mulloni, A., Drummond, T., and Schmalstieg, D. 2008. Pose tracking from natural features on mobile phones. In Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR). Google Scholar
Digital Library
- Wang, L. and Neumann, U. 2009. A robust approach for automatic registration of aerial images with untextured aerial LIDAR data. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Wolf, J., Burgard, W., and Burkhardt, H. 2002. Robust vision-based localization for mobile robots using an image retrieval system based on invariant features. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA).Google Scholar
- Zhou, Q. and Neumann, U. 2009. A streaming framework for seamless building reconstruction from large-scale aerial LIDAR data. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
Index Terms
Efficient matchings and mobile augmented reality
Recommendations
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented RealityAugmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...
Interactive Augmented Live Virtual Reality Streaming: A Health Care Application
ICMHI '18: Proceedings of the 2nd International Conference on Medical and Health InformaticsVirtual Reality (VR) technology has been around for decades; however, we have probably only begun to realize the practical applications until recent years. With increase of computing power, decrease of cost and physical dimension, a new class of ...
What is XR? Towards a Framework for Augmented and Virtual Reality
AbstractAugmented Reality (AR), Virtual Reality (VR), Mixed Reality, and Extended Reality (often – misleadingly – abbreviated as XR) are commonly used terms to describe how technologies generate or modify reality. However, academics and ...
Highlights- XR should not be used as an abbreviation for “Extended Reality”; X should be the placeholder for “all” new reality formats.






Comments