Indoor positioning system in visually-degraded environments with millimetre-wave radar and inertial sensors: demo abstract

ABSTRACT

Positional estimation is of great importance in the public safety sector. Emergency responders such as fire fighters, medical rescue teams, and the police will all benefit from a resilient positioning system to deliver safe and effective emergency services. Unfortunately, satellite navigation (e.g., GPS) offers limited coverage in indoor environments. It is also not possible to rely on infrastructure based solutions. To this end, wearable sensor-aided navigation techniques, such as those based on camera and Inertial Measurement Units (IMU), have recently emerged recently as an accurate, infrastructure-free solution. Together with an increase in the computational capabilities of mobile devices, motion estimation can be performed in real-time. In this demonstration, we present a real-time indoor positioning system which fuses millimetre-wave (mmWave) radar and IMU data via deep sensor fusion. We employ mmWave radar rather than an RGB camera as it provides better robustness to visual degradation (e.g., smoke, darkness, etc.) while at the same time requiring lower computational resources to enable runtime computation. We implemented the sensor system on a handheld device and a mobile computer running at 10 FPS to track a user inside an apartment. Good accuracy and resilience were exhibited even in poorly illuminated scenes.

References

1. C. X. Lu W. Wang A. Markham C. Chen, P. Zhao and N. Trigoni. 2020. Deep Learning based Pedestrian Inertial Navigation: Methods, Dataset and On-Device Inference. In IEEE Internet of Things Journal.
2. C. Chen, X. Lu, A. Markham, and N. Trigoni. 2018. IONet: Learning to Curethe Curse of Drift in Inertial Odometry. In Association for the Advancement of Artificial Intelligence.
3. C. Chen, S. Rosa, Y. Miao, C. X. Lu, W. Wu, A. Markham, and N. Trigoni. 2019. Selective sensor fusion for neural visual-inertial odometry. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.
4. S. Leutenegger, S. Lynen, M. Bosse, R. Siegwart, and P. Furgale. 2015. Keyframe-based visual-inertial odometry using nonlinear optimization. In The International Journal of Robotics Research 34, 3 (2015), 314--334.
5. C. X. Lu, M. R. U Saputra, P. Zhao, Y. Almalioglu, P. P. B. de Gusmao, C. Chen, K. Sun, N. Trigoni, and A. Markham. 2020. milliEgo: Single-chip mmWave Radar Aided Egomotion Estimation via Deep Sensor Fusion. In ACM Conference on Embedded Networked Sensor Systems (SenSys).
6. M. R. U. Saputra, P. P. B. de Gusmao, C. X. Lu, Y. Almalioglu, S. Rosa, C. Chen, J. Wahlström, W. Wang, A. Markham, and N. Trigoni. 2020. Deeptio: A deep thermalinertial odometry with visual hallucination. IEEE Robotics and Automation Letters 5, 2 (2020), 1672--1679.
7. P. Zhao, C. X. Lu, J. Wang, C. Chen, W. Wang, N. Trigoni, and A. Markham. 2019. mID: Tracking and Identifying People with Millimeter WaveRadar. In 15th International Conference on Distributed Computing in SensorSystems (DCOSS).

Index Terms

• Computer systems organization

  • Real-time systems

• Computing methodologies

  • Artificial intelligence

  • Machine learning

• Human-centered computing

  • Ubiquitous and mobile computing