Abstract
Augmented reality (AR) aims to render the world that users see and overlay information that reflects the real physical dynamics. The digital view could be potentially projected near the Point-of-Interest (POI) in a way that makes the virtual view attached to the POI even when the camera moves. Achieving smooth support for movements is a subject of extensive studies. One of the key problems is where the augmented information should be added to the field of vision in real time. Existing solutions either leverage GPS location for rendering outdoor AR views (hundreds of kilometers away) or rely on image markers for small-scale presentation (only for the marker region). To realize AR applications under various scales and dynamics, we propose a suite of algorithms for fine-grained AR view tracking to improve the accuracy of attitude and displacement estimation, reduce the drift, eliminate the marker, and lower the computation cost. Instead of requiring extremely high, accurate, absolute locations, we propose multimodal solutions according to mobility levels without additional hardware requirement. Experimental results demonstrate significantly less error in projecting and tracking the AR view. These results are expected to make users excited to explore their surroundings with enriched content.
- Apple. 2014. CMAttitude Class Reference. https://developer.apple.com/library/ios/documentation/CoreMotion/Reference/CMAttitude_Class/Reference/Reference.html.Google Scholar
- Ronald Azuma, Yohan Baillot, Reinhold Behringer, Steven Feiner, Simon Julier, and Blair MacIntyre. 2001. Recent advances in augmented reality. Comput. Graph. Appl. 21, 6, 34--47. Google Scholar
Digital Library
- BSD license. 2014. OpenCV. (2014). http://opencv.org.Google Scholar
- Manmohan Krishna Chandraker, Christoph Stock, and Axel Pinz. 2003. Real-Time Camera Pose in a Room. Springer.Google Scholar
- Bas des Bouvrie. 2011. Improving RGBD indoor mapping with IMU data. Ph.D., Dissertation, Masters thesis, Delft University of Technology.Google Scholar
- Friedrich Fraundorfer and Davide Scaramuzza. 2012. Visual odometry: Part II: Matching, robustness, optimization, and applications. IEEE Robotics & Automation Mag. 19, 2, 78--90.Google Scholar
Cross Ref
- Blippar Group. 2014. Layar. https://www.layar.com.Google Scholar
- Richard Hartley and Andrew Zisserman. 2003. Multiple View Geometry in Computer Vision. Cambridge University Press. Google Scholar
Digital Library
- J. D. Hol. 2011. Sensor fusion and calibration of inertial sensors, vision, Ultra-Wideband and GPS. Linköping Studies in Science and Technology. Dissertations 1368.Google Scholar
- Myung Hwangbo, Jun-Sik Kim, and Takeo Kanade. 2009. Inertial-aided KLT feature tracking for a moving camera. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2009). IEEE, 1909--1916. Google Scholar
Digital Library
- Hirokazu Kato. 2002. ARToolKit: Library for vision-based augmented reality. Technical Report, IEICE PRMU, 101 (652), 79--86.Google Scholar
- Bernd Kitt, Andreas Geiger, and Henning Lategahn. 2010. Visual odometry based on stereo image sequences with ransac-based outlier rejection scheme. In Proceedings of the Intelligent Vehicles Symposium (IV). IEEE, 486--492.Google Scholar
Cross Ref
- Tobias Langlotz, Claus Degendorfer, Alessandro Mulloni, Gerhard Schall, Gerhard Reitmayr, and Dieter Schmalstieg. 2011. Robust detection and tracking of annotations for outdoor augmented reality browsing. Comput. Graph. 35, 4, 831--840. Google Scholar
Digital Library
- Patrick Lazik and Anthony Rowe. 2012. Indoor pseudo-ranging of mobile devices using ultrasonic chirps. In Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems. ACM, 99--112. Google Scholar
Digital Library
- Hongbo Liu, Yu Gan, Jie Yang, Simon Sidhom, Yan Wang, Yingying Chen, and Fan Ye. 2012. Push the limit of WiFi based localization for smartphones. In Proceedings of the 18th Annual International Conference on Mobile Computing and Networking. ACM, 305--316. Google Scholar
Digital Library
- Kaikai Liu, Xinxin Liu, and Xiaolin Li. 2013. Guoguo: Enabling fine-grained indoor localization via smartphone. In Proceedings of the 11th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 235--248. Google Scholar
Digital Library
- Justin Gregory Manweiler, Puneet Jain, and Romit Roy Choudhury. 2012. Satellites in our pockets: An object positioning system using smartphones. In Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services. ACM, 211--224. Google Scholar
Digital Library
- F. Landis Markley and John L. Crassidis. 2014. Fundamentals of Spacecraft Attitude Determination and Control. Springer.Google Scholar
- Lorenz Meier, Petri Tanskanen, Lionel Heng, Gim Hee Lee, Friedrich Fraundorfer, and Marc Pollefeys. 2012. PIXHAWK: A micro aerial vehicle design for autonomous flight using onboard computer vision. Autonom. Robots 33, 1--2, 21--39. Google Scholar
Digital Library
- Mixare. 2011. mix Augmented Reality Engine. http://www.mixare.org.Google Scholar
- Alessandro Mulloni, Daniel Wagner, Istvan Barakonyi, and Dieter Schmalstieg. 2009. Indoor positioning and navigation with camera phones. Pervas. Comput. 8, 2, 22--31. Google Scholar
Digital Library
- R. Nandakumar, K. K. Chintalapudi, and V. N. Padmanabhan. 2012. Centaur: locating devices in an office environment. In Proceedings of the 18th Annual International Conference on Mobile Computing and Networking. ACM, 281--292. Google Scholar
Digital Library
- Rob Napier and Mugunth Kumar. 2014. iOS 7 Programming Pushing the Limits. Wiley.Google Scholar
- Joseph Newman, David Ingram, and Andy Hopper. 2001. Augmented reality in a wide area sentient environment. In Proceedings. IEEE and ACM International Symposium on Augmented Reality, 2001. IEEE, 77--86. Google Scholar
Digital Library
- William Russell Pensyl, Daniel Keith Jernigan, Tran Cong Thien Qui, Hsin Pei Fang, and Lee Shang Ping. 2008. Large area robust hybrid tracking with life-size avatar in mixed reality environment: For cultural and historical installation. In Proceedings of the 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry. ACM, 9. Google Scholar
Digital Library
- Qualcomm. 2015. Vuforia. https://www.qualcomm.com/products/vuforia.Google Scholar
- Pavel Rajmic. 2005. Method for real-time signal processing via wavelet transform. Nonlin. Anal. Algor. Speech Process. 368--378. Google Scholar
Digital Library
- Miguel Ribo, Markus Brandner, and Axel Pinz. 2004. A flexible software architecture for hybrid tracking. J. Robot. Syst. 21, 2, 53--62. Google Scholar
Digital Library
- Ethan Rublee, Vincent Rabaud, Kurt Konolige, and Gary Bradski. 2011. ORB: An efficient alternative to SIFT or SURF. In Proceedings of the IEEE International Conference on Computer Vision (ICCV). IEEE, 2564--2571. Google Scholar
Digital Library
- Guobin Shen, Zhuo Chen, Peichao Zhang, Thomas Moscibroda, and Yongguang Zhang. 2013. Walkie-markie: Indoor pathway mapping made easy. In Proceedings of the 10th USENIX Conference on Networked Systems Design and Implementation. USENIX Association, 85--98. Google Scholar
Digital Library
- D. W. F. Van Krevelen and R. Poelman. 2010. A survey of augmented reality technologies, applications and limitations. Int. J. Virt. Real. 9, 2, 1.Google Scholar
Cross Ref
- Daniel Wagner, Gerhard Reitmayr, Alessandro Mulloni, Tom Drummond, and Dieter Schmalstieg. 2010. Real-time detection and tracking for augmented reality on mobile phones. IEEE Trans. Visual. Comput. Graph. 16, 3, 355--368. Google Scholar
Digital Library
- He Wang, Souvik Sen, Ahmed Elgohary, Moustafa Farid, Moustafa Youssef, and Romit Roy Choudhury. 2012. No need to war-drive: Unsupervised indoor localization. In Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services. ACM, 197--210. Google Scholar
Digital Library
- Zac White. 2012. iPhone-AR-Toolkit. https://github.com/nielswh/iPhone-AR-Toolkit.Google Scholar
- Roni Yadlin. 2009. Attitude determination and bias estimation using kalman filtering. US Air Force Academy Report.Google Scholar
- Zheng Yang, Chenshu Wu, and Yunhao Liu. 2012. Locating in fingerprint space: Wireless indoor localization with little human intervention. In Proceedings of the 18th Annual International Conference on Mobile Computing and Networking. ACM, 269--280. Google Scholar
Digital Library
- Pengfei Zhou, Mo Li, and Guobin Shen. 2014. Use it free: Instantly knowing your phone attitude. In Proceedings of ACM MobiCom 2014. Google Scholar
Digital Library
Index Terms
Enabling Context-Aware Indoor Augmented Reality via Smartphone Sensing and Vision Tracking
Recommendations
Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System
IWAR '99: Proceedings of the 2nd IEEE and ACM International Workshop on Augmented RealityWe describe an augmented reality conferencing system which uses the overlay of virtual images on the real world. Remote collaborators are represented on Virtual Monitors which can be freely positioned about a user in space. Users can collaboratively ...
A Stereoscopic Video See-Through Augmented Reality System Based on Real-Time Vision-Based Registration
VR '00: Proceedings of the IEEE Virtual Reality 2000 ConferenceIn an augmented reality system, it is required to obtain the position and orientation of the user's viewpoint to display the composed image maintaining correct registration of real and virtual worlds. All the procedures must be done in real-time.This ...
An Extended Marker-Based Tracking System for Augmented Reality
WMSVM '10: Proceedings of the 2010 Second International Conference on Modeling, Simulation and Visualization MethodsFiducial marker systems consist of unique patterns mounted in the environment and computer vision algorithms that help automatically find features in digital camera images. They are useful for Augmented Reality (AR), robot navigation, 3D modeling, and ...






Comments