Augmented Reality Visualisation Concepts to Support Intraoperative Distance Estimation

ABSTRACT

The estimation of distances and spatial relations between surgical instruments and surrounding anatomical structures is a challenging task for clinicians in image-guided surgery. Using augmented reality (AR), navigation aids can be displayed directly at the intervention site to support the assessment of distances and reduce the risk of damage to healthy tissue. To this end, four distance-encoding visualisation concepts were developed using a head-mounted optical see-through AR setup and evaluated by conducting a comparison study. Results suggest the general advantage of the proposed methods compared to a blank visualisation providing no additional information. Using a Distance Sensor concept signalising the proximity of nearby structures resulted in the least time the instrument was located below 5mm to surrounding risk structures and yielded the least amount of collisions with them.

References

1. D. Black, C. Hansen, A. Nabavi, R. Kikinis, and H. Hahn. 2017. A Survey of Auditory Display in Image-Guided Interventions. Int J Comput Assist Radiol Surg 12, 10 (2017), 1665–1676.
2. Rositsa Bogdanova, Pierre Boulanger, and Bin Zheng. 2016. Depth perception of surgeons in minimally invasive surgery. Surgical Innovation 23, 5 (2016), 515–524.
3. Hyunseok Choi, Byunghyun Cho, Ken Masamune, Makoto Hashizume, and Jaesung Hong. 2016. An effective visualization technique for depth perception in augmented reality-based surgical navigation. Int J Med Robot 12, 1 (2016), 62–72.
4. Lucio T. De Paolis and Valerio De Luca. 2018. Augmented visualization with depth perception cues to improve the surgeon’s performance in minimally invasive surgery. Med Biol Eng Comput (2018), 1–19.
5. Christian Hansen, Stephan Zidowitz, Felix Ritter, Christoph Lange, Karl Oldhafer, and Horst K Hahn. 2013. Risk maps for liver surgery. Int J Comput Assist Radiol Surg 8, 3 (2013), 419–428.
6. Florian Heinrich, Gerd Schmidt, Kai Bornemann, Anna L Roethe, Walid I Essayed, and Christian Hansen. 2019. Visualization concepts to improve spatial perception for instrument navigation in image-guided surgery. In Medical Imaging: Image-Guided Procedures, Robotic Interventions, and Modeling, Vol. 10951. 1095125.
7. Dietrich Manzey, Stefan Röttger, J Elin Bahner-Heyne, Dirk Schulze-Kissing, Andreas Dietz, Jürgen Meixensberger, and Gero Strauss. 2009. Image-guided navigation: the surgeon’s perspective on performance consequences and human factors issues. Int J Med Robot 5, 3 (2009), 297–308.