skip to main content
research-article
Public Access

High-Precision 5DoF Tracking and Visualization of Catheter Placement in EVD of the Brain Using AR

Published:11 March 2020Publication History
Skip Abstract Section

Abstract

External ventricular drainage (EVD) is a high-risk medical procedure that involves inserting a catheter inside a patient’s skull, through the brain and into a ventricle, to drain cerebrospinal fluid and thus relieve elevated intracranial pressure. Once the catheter has entered the skull, its tip cannot be seen. The neurosurgeon has to imagine its location inside the cranium and direct it toward the ventricle using only anatomic landmarks. The EVD catheter is thin and thus hard to track using infra-red depth sensors. Traditional optical tracking using fiducial or other markers inevitably changes the shape or weight of the medical instrument. We present an augmented reality system that depicts the catheter for EVD and a new technique to precisely track the catheter inside the skull. Our technique uses a new linear marker detection method that requires minimal changes to the catheter and is well suited for tracking other thin medical devices that require high-precision tracking.

References

  1. Yuichiro Abe, Shigenobu Sato, Koji Kato, Takahiko Hyakumachi, Yasushi Yanagibashi, Manabu Ito, and Kuniyoshi Abumi. 2013. A novel 3D guidance system using augmented reality for percutaneous vertebroplasty. Journal of Neurosurgery: Spine 19, 4 (2013), 492--501.Google ScholarGoogle Scholar
  2. Kamyar Abhari, John S. H. Baxter, Elvis C. S. Chen, Ali R. Khan, Terry M. Peters, Sandrine de Ribaupierre, and Roy Eagleson. 2014. Training for planning tumour resection: Augmented reality and human factors. IEEE Transactions on Biomedical Engineering 62, 6 (2014), 1466--1477.Google ScholarGoogle Scholar
  3. Marc-André Ameller, Bill Triggs, and Long Quan. 2000. Camera pose revisited: New linear algorithms. https://hal.inria.fr/inria-00548306.Google ScholarGoogle Scholar
  4. Ehsan Azimi, Camilo Molina, Alexander Chang, Judy Huang, Chien-Ming Huang, and Peter Kazanzides. 2018. Interactive training and operation ecosystem for surgical tasks in mixed reality. In OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis. Springer, 20--29.Google ScholarGoogle Scholar
  5. P. Pat Banerjee, Cristian J. Luciano, G. Michael Lemole Jr., Fady T. Charbel, and Michael Y. Oh. 2007. Accuracy of ventriculostomy catheter placement using a head-and hand-tracked high-resolution virtual reality simulator with haptic feedback. Journal of Neurosurgery 107, 3 (2007), 515--521.Google ScholarGoogle ScholarCross RefCross Ref
  6. Ehsan Basafa, Pezhman Foroughi, Martin Hossbach, Jasmine Bhanushali, and Philipp Stolka. 2017. Visual tracking for multi-modality computer-assisted image guidance. In Medical Imaging 2017: Image-Guided Procedures, Robotic Interventions, and Modeling, Vol. 10135. International Society for Optics and Photonics, Bellingham, WA, 101352S.Google ScholarGoogle Scholar
  7. Olivier Cros, Morten Volden, Jens Jørgen Flaaris, Lars Chebørløv Brix, Christian Fischer Pedersen, Kim Vang Hansen, Ole Vilhelm Larsen, Lasse Riis Østergaard, and Jens Haase. 2002. Simulating the puncture of the human ventricle. In Proceedings of the 10th Annual Medicine Meets Virtual Reality Conference.Google ScholarGoogle Scholar
  8. Andrew Benjamin Cutler, Shervin Rahimpour, Yameng Liu, Nandan Lad, Regis Kopper, and Patrick Codd. 2017. Development of augmented reality-based neuro-navigation system for use in external ventricular drain placement. Journal of Neurosurgery . 126 (2017), A1438. https://youtu.be/qqykWW9f41Q.Google ScholarGoogle Scholar
  9. Ruofei Du, Ming Chuang, Wayne Chang, Hugues Hoppe, and Amitabh Varshney. 2019. Montage4D: Real-time seamless fusion and stylization of multiview video textures. Journal of Computer Graphics Techniques 8, 1 (Jan. 2019), 1--34. DOI:https://doi.org/10.1145/3190834.3190843Google ScholarGoogle Scholar
  10. Philip J. Edwards, Derek L. G. Hill, David J. Hawkes, R. Spink, Alan C. F. Colchester, A. Strong, and M. Gleeson. 1995. Neurosurgical guidance using the stereo microscope. In Computer Vision, Virtual Reality and Robotics in Medicine. Springer, 555--564.Google ScholarGoogle Scholar
  11. Philip J. Edwards, Laura G. Johnson, David J. Hawkes, Michael R. Fenlon, Anthony J. Strong, and Michael J. Gleeson. 2004. Clinical experience and perception in stereo augmented reality surgical navigation. In Proceedings of the International Workshop on Medical Imaging and Virtual Reality. Springer, 369--376.Google ScholarGoogle Scholar
  12. P. J. Edwards, A. P. King, C. R. Maurer, D. A. De Cunha, D. J. Hawkes, D. L. G. Hill, R. P. Gaston, et al. 2000. Design and evaluation of a system for microscope-assisted guided interventions (MAGI). IEEE Transactions on Medical Imaging 19, 11 (2000), 1082--1093.Google ScholarGoogle ScholarCross RefCross Ref
  13. Zhencheng Fan, Guowen Chen, Junchen Wang, and Hongen Liao. 2017. Spatial position measurement system for surgical navigation using 3-D image marker-based tracking tools with compact volume. IEEE Transactions on Biomedical Engineering 65, 2 (2017), 378--389.Google ScholarGoogle Scholar
  14. Taylor Frantz, Bart Jansen, Johnny Duerinck, and Jef Vandemeulebroucke. 2018. Augmenting Microsoft’s HoloLens with vuforia tracking for neuronavigation. Healthcare Technology Letters 5, 5 (2018), 221--225.Google ScholarGoogle ScholarCross RefCross Ref
  15. Herbert I. Fried, Barnett R. Nathan, A. Shaun Rowe, Joseph M. Zabramski, Norberto Andaluz, Adarsh Bhimraj, Mary McKenna Guanci, David B. Seder, and Jeffrey M. Singh. 2016. The insertion and management of external ventricular drains: An evidence-based consensus statement. Neurocritical Care 24, 1 (2016), 61--81.Google ScholarGoogle Scholar
  16. Xiao-Shan Gao, Xiao-Rong Hou, Jianliang Tang, and Hang-Fei Cheng. 2003. Complete solution classification for the perspective-three-point problem. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 8 (2003), 930--943.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Daipayan Guha, Naif M. Alotaibi, Nhu Nguyen, Shaurya Gupta, Christopher McFaul, and Victor X. D. Yang. 2017. Augmented reality in neurosurgery: A review of current concepts and emerging applications. Canadian Journal of Neurological Sciences 44, 3 (2017), 235--245.Google ScholarGoogle ScholarCross RefCross Ref
  18. David R. Huyette, Benjamin J. Turnbow, Christian Kaufman, Dale F. Vaslow, Benjamin B. Whiting, and Michael Y. Oh. 2008. Accuracy of the freehand pass technique for ventriculostomy catheter placement: Retrospective assessment using computed tomography scans. Journal of Neurosurgery 108, 1 (2008), 88--91.Google ScholarGoogle ScholarCross RefCross Ref
  19. D. Inoue, B. Cho, M. Mori, Y. Kikkawa, T. Amano, A. Nakamizo, K. Yoshimoto, et al. 2013. Preliminary study on the clinical application of augmented reality neuronavigation. Journal of Neurological Surgery Part A: Central European Neurosurgery 74, 02 (2013), 071--076.Google ScholarGoogle Scholar
  20. Udaya K. Kakarla, Louis J. Kim, Steven W. Chang, Nicholas Theodore, and Robert F. Spetzler. 2008. Safety and accuracy of bedside external ventricular drain placement. Operative Neurosurgery 63, suppl._1 (2008), ONS162--ONS167.Google ScholarGoogle Scholar
  21. Marta Kersten-Oertel, Pierre Jannin, and D. Louis Collins. 2013. The state of the art of visualization in mixed reality image guided surgery. Computerized Medical Imaging and Graphics 37, 2 (2013), 98--112.Google ScholarGoogle ScholarCross RefCross Ref
  22. Ralf A. Kockro, Yeo Tseng Tsai, Ivan Ng, Peter Hwang, Chuangui Zhu, Kusuma Agusanto, Liang Xiao Hong, and Luis Serra. 2009. DEX-Ray: Augmented reality neurosurgical navigation with a handheld video probe. Neurosurgery 65, 4 (2009), 795--808.Google ScholarGoogle ScholarCross RefCross Ref
  23. G. Krombach, A. Ganser, Ch Fricke, V. Rohde, M. Reinges, J. Gilsbach, and U. Spetzger. 2000. Virtual placement of frontal ventricular catheters using frameless neuronavigation: An “unbloody training” for young neurosurgeons. Minimally Invasive Neurosurgery 43, 04 (2000), 171--175.Google ScholarGoogle Scholar
  24. Timur Kuzhagaliyev, Neil T. Clancy, Mirek Janatka, Kevin Tchaka, Francisco Vasconcelos, Matthew J. Clarkson, Kurinchi Gurusamy, David J. Hawkes, Brian Davidson, and Danail Stoyanov. 2018. Augmented reality needle ablation guidance tool for irreversible electroporation in the pancreas. In Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling, Vol. 10576. International Society for Optics and Photonics, Bellingham, WA, 1057613.Google ScholarGoogle Scholar
  25. G. Michael Lemole Jr., P. Pat Banerjee, Cristian Luciano, Sergey Neckrysh, and Fady T. Charbel. 2007. Virtual reality in neurosurgical education: Part-task ventriculostomy simulation with dynamic visual and haptic feedback. Neurosurgery 61, 1 (2007), 142--149.Google ScholarGoogle Scholar
  26. Ye Li, Xiaolei Chen, Ning Wang, Wenyao Zhang, Dawei Li, Lei Zhang, Xin Qu, et al. 2018. A wearable mixed-reality holographic computer for guiding external ventricular drain insertion at the bedside. Journal of Neurosurgery 1, AOP (2018), 1--8.Google ScholarGoogle Scholar
  27. M. A. Lin, A. F. Siu, J. H. Bae, M. R. Cutkosky, and B. L. Daniel. 2018. HoloNeedle: Augmented reality guidance system for needle placement investigating the advantages of three-dimensional needle shape reconstruction. IEEE Robotics and Automation Letters 3, 4 (Oct. 2018), 4156--4162. DOI:https://doi.org/10.1109/LRA.2018.2863381Google ScholarGoogle Scholar
  28. Eduardo E. Lovo, Juan C. Quintana, Manuel C. Puebla, Gonzalo Torrealba, José L. Santos, Isidro H. Lira, and Patricio Tagle. 2007. A novel, inexpensive method of image coregistration for applications in image-guided surgery using augmented reality. Operative Neurosurgery 60, suppl._4 (2007), ONS--366.Google ScholarGoogle Scholar
  29. David Low, Cheng Kiang Lee, Lee Lian Tay Dip, Wai Hoe Ng, Beng Ti Ang, and Ivan Ng. 2010. Augmented reality neurosurgical planning and navigation for surgical excision of parasagittal, falcine and convexity meningiomas. British Journal of Neurosurgery 24, 1 (2010), 69--74.Google ScholarGoogle ScholarCross RefCross Ref
  30. Cristian Luciano, Pat Banerjee, G. Michael Lemole, and Fady Charbel. 2005. Second generation haptic ventriculostomy simulator using the ImmersiveTouch system. Studies in Health Technology and Informatics 119 (2005), 343.Google ScholarGoogle Scholar
  31. Eric Marchand, Hideaki Uchiyama, and Fabien Spindler. 2016. Pose estimation for augmented reality: A hands-on survey. IEEE Transactions on Visualization and Computer Graphics 22, 12 (2016), 2633--2651.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Yoshitaka Masutani, Takeyoshi Dohi, Fumitaka Yamane, Hiroshi Iseki, and Kintomo Takakura. 1998. Augmented reality visualization system for intravascular neurosurgery. Computer Aided Surgery 3, 5 (1998), 239--247.Google ScholarGoogle ScholarCross RefCross Ref
  33. Calvin R. Maurer Jr., Frank Sauer, Bo Hu, Benedicte Bascle, Bernhard Geiger, Fabian Wenzel, Filippo Recchi, et al. 2001. Augmented reality visualization of brain structures with stereo and kinetic depth cues: System description and initial evaluation with head phantom. Medical Imaging 2001 (2001), 445--456.Google ScholarGoogle Scholar
  34. Xiaoxu Meng, Ruofei Du, Matthias Zwicker, and Amitabh Varshney. 2018. Kernel foveated rendering. Proceedings of the ACM on Computer Graphics and Interactive Techniques 1, 1, (May 2018), Article 5, 20 pages. DOI:https://doi.org/10.1145/3203199Google ScholarGoogle Scholar
  35. Antonio Meola, Fabrizio Cutolo, Marina Carbone, Federico Cagnazzo, Mauro Ferrari, and Vincenzo Ferrari. 2016. Augmented reality in neurosurgery: A systematic review. Neurosurgical Review 40, 4 (2016), 537--548.Google ScholarGoogle Scholar
  36. Mohammad Najafi, Purang Abolmaesumi, and Robert Rohling. 2015. Single-camera closed-form real-time needle tracking for ultrasound-guided needle insertion. Ultrasound in Medicine 8 Biology 41, 10 (2015), 2663--2676.Google ScholarGoogle Scholar
  37. Mohammad Najafi and Robert Rohling. 2011. Single camera closed-form real-time needle trajectory tracking for ultrasound. In Medical Imaging 2011: Visualization, Image-Guided Procedures, and Modeling, Vol. 7964. International Society for Optics and Photonics, Bellingham, WA, 79641F.Google ScholarGoogle Scholar
  38. Diederick C. Niehorster, Li Li, and Markus Lappe. 2017. The accuracy and precision of position and orientation tracking in the HTC Vive virtual reality system for scientific research. i-Perception 8, 3 (2017), 177--205.Google ScholarGoogle ScholarCross RefCross Ref
  39. Shaun T. O’Leary, Max K. Kole, Devon A. Hoover, Steven E. Hysell, Ajith Thomas, and Christopher I. Shaffrey. 2000. Efficacy of the Ghajar Guide revisited: A prospective study. Journal of Neurosurgery 92, 5 (2000), 801--803.Google ScholarGoogle Scholar
  40. Nicholas I. Phillips and Nigel W. John. 2000. Web-based surgical simulation for ventricular catheterization. Neurosurgery 46, 4 (2000), 933--937.Google ScholarGoogle Scholar
  41. Long Quan and Zhongdan Lan. 1999. Linear n-point camera pose determination. IEEE Transactions on Pattern Analysis and Machine Intelligence 21, 8 (1999), 774--780.Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Faith C. Robertson, Muhammad M. Abd-El-Barr, Srinivasan Mukundan, and William B. Gormley. 2017. Ventriculostomy-associated hemorrhage: A risk assessment by radiographic simulation. Journal of Neurosurgery 127, 3 (2017), 532--536.Google ScholarGoogle Scholar
  43. Frank Sauer, Ali Khamene, Benedicte Bascle, and Gregory J. Rubino. 2001. A head-mounted display system for augmented reality image guidance: Towards clinical evaluation for iMRI-guided neurosurgery. In Proceedings of the 4th International Conference on Medical Image Computing and Computer-Assisted Intervention. 707--716.Google ScholarGoogle Scholar
  44. Clemens M. Schirmer, J. Bradley Elder, Ben Roitberg, and Darlene A. Lobel. 2013. Virtual reality--based simulation training for ventriculostomy: An evidence-based approach. Neurosurgery 73, suppl. 1 (2013), S66--S73.Google ScholarGoogle Scholar
  45. M. Scholz, W. Konen, S. Tombrock, B. Fricke, L. Adams, M. Von Duering, A. Hentsch, L. Heuser, and A. G. Harders. 1998. Development of an endoscopic navigation system based on digital image processing. Computer Aided Surgery 3, 3 (1998), 134--143.Google ScholarGoogle Scholar
  46. Ramin Shahidi, Bai Wang, Marc Epitaux, Robert Grzeszczuk, and John Adler. 1998. Volumetric image guidance via a stereotactic endoscope. In Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention. 241--252.Google ScholarGoogle Scholar
  47. Visish M. Srinivasan, Brent R. O’Neill, Diana Jho, Donald M. Whiting, and Michael Y. Oh. 2014. The history of external ventricular drainage: Historical vignette. Journal of Neurosurgery 120, 1 (2014), 228--236.Google ScholarGoogle Scholar
  48. Philipp J. Stolka, Pezhman Foroughi, Matthew Rendina, Clifford R. Weiss, Gregory D. Hager, and Emad M. Boctor. 2014. Needle guidance using handheld stereo vision and projection for ultrasound-based interventions. In Medical Image Computing and Computer-Assisted Intervention—MICCAI 2014. Lecture Notes in Computer Science, Vol. 8647. Springer, 684--691.Google ScholarGoogle Scholar
  49. Xuetong Sun and Amitabh Varshney. 2018. Investigating perception time in the far peripheral vision for virtual and augmented reality. In Proceedings of the 15th ACM Symposium on Applied Perception (SAP’18). ACM, New York, NY, Article 13, 8 pages. DOI:https://doi.org/10.1145/3225153.3225160Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Bruce L. Tai, Deborah Rooney, Francesca Stephenson, Peng-Siang Liao, Oren Sagher, Albert J. Shih, and Luis E. Savastano. 2015. Development of a 3D-printed external ventricular drain placement simulator. Journal of Neurosurgery 123, 4 (2015), 1070--1076.Google ScholarGoogle Scholar
  51. Peter Y. M. Woo, Ben C. F. Ng, Jacob X. Xiao, Daniel Wong, Andrew Seto, Sandy Lam, Carmen Yim, et al. 2019. The importance of aspirin, catheterization accuracy, and catheter design in external ventricular drainage-related hemorrhage: A multicenter study of 1002 procedures. Acta Neurochirurgica 161, 8 (Aug. 2019), 1623--1632.Google ScholarGoogle Scholar
  52. Rachel Yudkowsky, Cristian Luciano, Pat Banerjee, Alan Schwartz, Ali Alaraj, G. Michael Lemole Jr., Fady Charbel, et al. 2013. Practice on an augmented reality/haptic simulator and library of virtual brains improves residents’ ability to perform a ventriculostomy. Simulation in Healthcare 8, 1 (2013), 25--31.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. High-Precision 5DoF Tracking and Visualization of Catheter Placement in EVD of the Brain Using AR

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!