Abstract
External ventricular drainage (EVD) is a high-risk medical procedure that involves inserting a catheter inside a patient’s skull, through the brain and into a ventricle, to drain cerebrospinal fluid and thus relieve elevated intracranial pressure. Once the catheter has entered the skull, its tip cannot be seen. The neurosurgeon has to imagine its location inside the cranium and direct it toward the ventricle using only anatomic landmarks. The EVD catheter is thin and thus hard to track using infra-red depth sensors. Traditional optical tracking using fiducial or other markers inevitably changes the shape or weight of the medical instrument. We present an augmented reality system that depicts the catheter for EVD and a new technique to precisely track the catheter inside the skull. Our technique uses a new linear marker detection method that requires minimal changes to the catheter and is well suited for tracking other thin medical devices that require high-precision tracking.
- Yuichiro Abe, Shigenobu Sato, Koji Kato, Takahiko Hyakumachi, Yasushi Yanagibashi, Manabu Ito, and Kuniyoshi Abumi. 2013. A novel 3D guidance system using augmented reality for percutaneous vertebroplasty. Journal of Neurosurgery: Spine 19, 4 (2013), 492--501.Google Scholar
- Kamyar Abhari, John S. H. Baxter, Elvis C. S. Chen, Ali R. Khan, Terry M. Peters, Sandrine de Ribaupierre, and Roy Eagleson. 2014. Training for planning tumour resection: Augmented reality and human factors. IEEE Transactions on Biomedical Engineering 62, 6 (2014), 1466--1477.Google Scholar
- Marc-André Ameller, Bill Triggs, and Long Quan. 2000. Camera pose revisited: New linear algorithms. https://hal.inria.fr/inria-00548306.Google Scholar
- Ehsan Azimi, Camilo Molina, Alexander Chang, Judy Huang, Chien-Ming Huang, and Peter Kazanzides. 2018. Interactive training and operation ecosystem for surgical tasks in mixed reality. In OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis. Springer, 20--29.Google Scholar
- P. Pat Banerjee, Cristian J. Luciano, G. Michael Lemole Jr., Fady T. Charbel, and Michael Y. Oh. 2007. Accuracy of ventriculostomy catheter placement using a head-and hand-tracked high-resolution virtual reality simulator with haptic feedback. Journal of Neurosurgery 107, 3 (2007), 515--521.Google Scholar
Cross Ref
- Ehsan Basafa, Pezhman Foroughi, Martin Hossbach, Jasmine Bhanushali, and Philipp Stolka. 2017. Visual tracking for multi-modality computer-assisted image guidance. In Medical Imaging 2017: Image-Guided Procedures, Robotic Interventions, and Modeling, Vol. 10135. International Society for Optics and Photonics, Bellingham, WA, 101352S.Google Scholar
- Olivier Cros, Morten Volden, Jens Jørgen Flaaris, Lars Chebørløv Brix, Christian Fischer Pedersen, Kim Vang Hansen, Ole Vilhelm Larsen, Lasse Riis Østergaard, and Jens Haase. 2002. Simulating the puncture of the human ventricle. In Proceedings of the 10th Annual Medicine Meets Virtual Reality Conference.Google Scholar
- Andrew Benjamin Cutler, Shervin Rahimpour, Yameng Liu, Nandan Lad, Regis Kopper, and Patrick Codd. 2017. Development of augmented reality-based neuro-navigation system for use in external ventricular drain placement. Journal of Neurosurgery . 126 (2017), A1438. https://youtu.be/qqykWW9f41Q.Google Scholar
- Ruofei Du, Ming Chuang, Wayne Chang, Hugues Hoppe, and Amitabh Varshney. 2019. Montage4D: Real-time seamless fusion and stylization of multiview video textures. Journal of Computer Graphics Techniques 8, 1 (Jan. 2019), 1--34. DOI:https://doi.org/10.1145/3190834.3190843Google Scholar
- Philip J. Edwards, Derek L. G. Hill, David J. Hawkes, R. Spink, Alan C. F. Colchester, A. Strong, and M. Gleeson. 1995. Neurosurgical guidance using the stereo microscope. In Computer Vision, Virtual Reality and Robotics in Medicine. Springer, 555--564.Google Scholar
- Philip J. Edwards, Laura G. Johnson, David J. Hawkes, Michael R. Fenlon, Anthony J. Strong, and Michael J. Gleeson. 2004. Clinical experience and perception in stereo augmented reality surgical navigation. In Proceedings of the International Workshop on Medical Imaging and Virtual Reality. Springer, 369--376.Google Scholar
- P. J. Edwards, A. P. King, C. R. Maurer, D. A. De Cunha, D. J. Hawkes, D. L. G. Hill, R. P. Gaston, et al. 2000. Design and evaluation of a system for microscope-assisted guided interventions (MAGI). IEEE Transactions on Medical Imaging 19, 11 (2000), 1082--1093.Google Scholar
Cross Ref
- Zhencheng Fan, Guowen Chen, Junchen Wang, and Hongen Liao. 2017. Spatial position measurement system for surgical navigation using 3-D image marker-based tracking tools with compact volume. IEEE Transactions on Biomedical Engineering 65, 2 (2017), 378--389.Google Scholar
- Taylor Frantz, Bart Jansen, Johnny Duerinck, and Jef Vandemeulebroucke. 2018. Augmenting Microsoft’s HoloLens with vuforia tracking for neuronavigation. Healthcare Technology Letters 5, 5 (2018), 221--225.Google Scholar
Cross Ref
- Herbert I. Fried, Barnett R. Nathan, A. Shaun Rowe, Joseph M. Zabramski, Norberto Andaluz, Adarsh Bhimraj, Mary McKenna Guanci, David B. Seder, and Jeffrey M. Singh. 2016. The insertion and management of external ventricular drains: An evidence-based consensus statement. Neurocritical Care 24, 1 (2016), 61--81.Google Scholar
- Xiao-Shan Gao, Xiao-Rong Hou, Jianliang Tang, and Hang-Fei Cheng. 2003. Complete solution classification for the perspective-three-point problem. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 8 (2003), 930--943.Google Scholar
Digital Library
- Daipayan Guha, Naif M. Alotaibi, Nhu Nguyen, Shaurya Gupta, Christopher McFaul, and Victor X. D. Yang. 2017. Augmented reality in neurosurgery: A review of current concepts and emerging applications. Canadian Journal of Neurological Sciences 44, 3 (2017), 235--245.Google Scholar
Cross Ref
- David R. Huyette, Benjamin J. Turnbow, Christian Kaufman, Dale F. Vaslow, Benjamin B. Whiting, and Michael Y. Oh. 2008. Accuracy of the freehand pass technique for ventriculostomy catheter placement: Retrospective assessment using computed tomography scans. Journal of Neurosurgery 108, 1 (2008), 88--91.Google Scholar
Cross Ref
- D. Inoue, B. Cho, M. Mori, Y. Kikkawa, T. Amano, A. Nakamizo, K. Yoshimoto, et al. 2013. Preliminary study on the clinical application of augmented reality neuronavigation. Journal of Neurological Surgery Part A: Central European Neurosurgery 74, 02 (2013), 071--076.Google Scholar
- Udaya K. Kakarla, Louis J. Kim, Steven W. Chang, Nicholas Theodore, and Robert F. Spetzler. 2008. Safety and accuracy of bedside external ventricular drain placement. Operative Neurosurgery 63, suppl._1 (2008), ONS162--ONS167.Google Scholar
- Marta Kersten-Oertel, Pierre Jannin, and D. Louis Collins. 2013. The state of the art of visualization in mixed reality image guided surgery. Computerized Medical Imaging and Graphics 37, 2 (2013), 98--112.Google Scholar
Cross Ref
- Ralf A. Kockro, Yeo Tseng Tsai, Ivan Ng, Peter Hwang, Chuangui Zhu, Kusuma Agusanto, Liang Xiao Hong, and Luis Serra. 2009. DEX-Ray: Augmented reality neurosurgical navigation with a handheld video probe. Neurosurgery 65, 4 (2009), 795--808.Google Scholar
Cross Ref
- G. Krombach, A. Ganser, Ch Fricke, V. Rohde, M. Reinges, J. Gilsbach, and U. Spetzger. 2000. Virtual placement of frontal ventricular catheters using frameless neuronavigation: An “unbloody training” for young neurosurgeons. Minimally Invasive Neurosurgery 43, 04 (2000), 171--175.Google Scholar
- Timur Kuzhagaliyev, Neil T. Clancy, Mirek Janatka, Kevin Tchaka, Francisco Vasconcelos, Matthew J. Clarkson, Kurinchi Gurusamy, David J. Hawkes, Brian Davidson, and Danail Stoyanov. 2018. Augmented reality needle ablation guidance tool for irreversible electroporation in the pancreas. In Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling, Vol. 10576. International Society for Optics and Photonics, Bellingham, WA, 1057613.Google Scholar
- G. Michael Lemole Jr., P. Pat Banerjee, Cristian Luciano, Sergey Neckrysh, and Fady T. Charbel. 2007. Virtual reality in neurosurgical education: Part-task ventriculostomy simulation with dynamic visual and haptic feedback. Neurosurgery 61, 1 (2007), 142--149.Google Scholar
- Ye Li, Xiaolei Chen, Ning Wang, Wenyao Zhang, Dawei Li, Lei Zhang, Xin Qu, et al. 2018. A wearable mixed-reality holographic computer for guiding external ventricular drain insertion at the bedside. Journal of Neurosurgery 1, AOP (2018), 1--8.Google Scholar
- M. A. Lin, A. F. Siu, J. H. Bae, M. R. Cutkosky, and B. L. Daniel. 2018. HoloNeedle: Augmented reality guidance system for needle placement investigating the advantages of three-dimensional needle shape reconstruction. IEEE Robotics and Automation Letters 3, 4 (Oct. 2018), 4156--4162. DOI:https://doi.org/10.1109/LRA.2018.2863381Google Scholar
- Eduardo E. Lovo, Juan C. Quintana, Manuel C. Puebla, Gonzalo Torrealba, José L. Santos, Isidro H. Lira, and Patricio Tagle. 2007. A novel, inexpensive method of image coregistration for applications in image-guided surgery using augmented reality. Operative Neurosurgery 60, suppl._4 (2007), ONS--366.Google Scholar
- David Low, Cheng Kiang Lee, Lee Lian Tay Dip, Wai Hoe Ng, Beng Ti Ang, and Ivan Ng. 2010. Augmented reality neurosurgical planning and navigation for surgical excision of parasagittal, falcine and convexity meningiomas. British Journal of Neurosurgery 24, 1 (2010), 69--74.Google Scholar
Cross Ref
- Cristian Luciano, Pat Banerjee, G. Michael Lemole, and Fady Charbel. 2005. Second generation haptic ventriculostomy simulator using the ImmersiveTouch system. Studies in Health Technology and Informatics 119 (2005), 343.Google Scholar
- Eric Marchand, Hideaki Uchiyama, and Fabien Spindler. 2016. Pose estimation for augmented reality: A hands-on survey. IEEE Transactions on Visualization and Computer Graphics 22, 12 (2016), 2633--2651.Google Scholar
Digital Library
- Yoshitaka Masutani, Takeyoshi Dohi, Fumitaka Yamane, Hiroshi Iseki, and Kintomo Takakura. 1998. Augmented reality visualization system for intravascular neurosurgery. Computer Aided Surgery 3, 5 (1998), 239--247.Google Scholar
Cross Ref
- Calvin R. Maurer Jr., Frank Sauer, Bo Hu, Benedicte Bascle, Bernhard Geiger, Fabian Wenzel, Filippo Recchi, et al. 2001. Augmented reality visualization of brain structures with stereo and kinetic depth cues: System description and initial evaluation with head phantom. Medical Imaging 2001 (2001), 445--456.Google Scholar
- Xiaoxu Meng, Ruofei Du, Matthias Zwicker, and Amitabh Varshney. 2018. Kernel foveated rendering. Proceedings of the ACM on Computer Graphics and Interactive Techniques 1, 1, (May 2018), Article 5, 20 pages. DOI:https://doi.org/10.1145/3203199Google Scholar
- Antonio Meola, Fabrizio Cutolo, Marina Carbone, Federico Cagnazzo, Mauro Ferrari, and Vincenzo Ferrari. 2016. Augmented reality in neurosurgery: A systematic review. Neurosurgical Review 40, 4 (2016), 537--548.Google Scholar
- Mohammad Najafi, Purang Abolmaesumi, and Robert Rohling. 2015. Single-camera closed-form real-time needle tracking for ultrasound-guided needle insertion. Ultrasound in Medicine 8 Biology 41, 10 (2015), 2663--2676.Google Scholar
- Mohammad Najafi and Robert Rohling. 2011. Single camera closed-form real-time needle trajectory tracking for ultrasound. In Medical Imaging 2011: Visualization, Image-Guided Procedures, and Modeling, Vol. 7964. International Society for Optics and Photonics, Bellingham, WA, 79641F.Google Scholar
- Diederick C. Niehorster, Li Li, and Markus Lappe. 2017. The accuracy and precision of position and orientation tracking in the HTC Vive virtual reality system for scientific research. i-Perception 8, 3 (2017), 177--205.Google Scholar
Cross Ref
- Shaun T. O’Leary, Max K. Kole, Devon A. Hoover, Steven E. Hysell, Ajith Thomas, and Christopher I. Shaffrey. 2000. Efficacy of the Ghajar Guide revisited: A prospective study. Journal of Neurosurgery 92, 5 (2000), 801--803.Google Scholar
- Nicholas I. Phillips and Nigel W. John. 2000. Web-based surgical simulation for ventricular catheterization. Neurosurgery 46, 4 (2000), 933--937.Google Scholar
- Long Quan and Zhongdan Lan. 1999. Linear n-point camera pose determination. IEEE Transactions on Pattern Analysis and Machine Intelligence 21, 8 (1999), 774--780.Google Scholar
Digital Library
- Faith C. Robertson, Muhammad M. Abd-El-Barr, Srinivasan Mukundan, and William B. Gormley. 2017. Ventriculostomy-associated hemorrhage: A risk assessment by radiographic simulation. Journal of Neurosurgery 127, 3 (2017), 532--536.Google Scholar
- Frank Sauer, Ali Khamene, Benedicte Bascle, and Gregory J. Rubino. 2001. A head-mounted display system for augmented reality image guidance: Towards clinical evaluation for iMRI-guided neurosurgery. In Proceedings of the 4th International Conference on Medical Image Computing and Computer-Assisted Intervention. 707--716.Google Scholar
- Clemens M. Schirmer, J. Bradley Elder, Ben Roitberg, and Darlene A. Lobel. 2013. Virtual reality--based simulation training for ventriculostomy: An evidence-based approach. Neurosurgery 73, suppl. 1 (2013), S66--S73.Google Scholar
- M. Scholz, W. Konen, S. Tombrock, B. Fricke, L. Adams, M. Von Duering, A. Hentsch, L. Heuser, and A. G. Harders. 1998. Development of an endoscopic navigation system based on digital image processing. Computer Aided Surgery 3, 3 (1998), 134--143.Google Scholar
- Ramin Shahidi, Bai Wang, Marc Epitaux, Robert Grzeszczuk, and John Adler. 1998. Volumetric image guidance via a stereotactic endoscope. In Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention. 241--252.Google Scholar
- Visish M. Srinivasan, Brent R. O’Neill, Diana Jho, Donald M. Whiting, and Michael Y. Oh. 2014. The history of external ventricular drainage: Historical vignette. Journal of Neurosurgery 120, 1 (2014), 228--236.Google Scholar
- Philipp J. Stolka, Pezhman Foroughi, Matthew Rendina, Clifford R. Weiss, Gregory D. Hager, and Emad M. Boctor. 2014. Needle guidance using handheld stereo vision and projection for ultrasound-based interventions. In Medical Image Computing and Computer-Assisted Intervention—MICCAI 2014. Lecture Notes in Computer Science, Vol. 8647. Springer, 684--691.Google Scholar
- Xuetong Sun and Amitabh Varshney. 2018. Investigating perception time in the far peripheral vision for virtual and augmented reality. In Proceedings of the 15th ACM Symposium on Applied Perception (SAP’18). ACM, New York, NY, Article 13, 8 pages. DOI:https://doi.org/10.1145/3225153.3225160Google Scholar
Digital Library
- Bruce L. Tai, Deborah Rooney, Francesca Stephenson, Peng-Siang Liao, Oren Sagher, Albert J. Shih, and Luis E. Savastano. 2015. Development of a 3D-printed external ventricular drain placement simulator. Journal of Neurosurgery 123, 4 (2015), 1070--1076.Google Scholar
- Peter Y. M. Woo, Ben C. F. Ng, Jacob X. Xiao, Daniel Wong, Andrew Seto, Sandy Lam, Carmen Yim, et al. 2019. The importance of aspirin, catheterization accuracy, and catheter design in external ventricular drainage-related hemorrhage: A multicenter study of 1002 procedures. Acta Neurochirurgica 161, 8 (Aug. 2019), 1623--1632.Google Scholar
- Rachel Yudkowsky, Cristian Luciano, Pat Banerjee, Alan Schwartz, Ali Alaraj, G. Michael Lemole Jr., Fady Charbel, et al. 2013. Practice on an augmented reality/haptic simulator and library of virtual brains improves residents’ ability to perform a ventriculostomy. Simulation in Healthcare 8, 1 (2013), 25--31.Google Scholar
Cross Ref
Index Terms
High-Precision 5DoF Tracking and Visualization of Catheter Placement in EVD of the Brain Using AR
Recommendations
Catheter tracking: filter-based vs. learning-based
Proceedings of the 32nd DAGM conference on Pattern recognitionAtrial fibrillation is the most common sustained arrhythmia. One important treatment option is radio-frequency catheter ablation (RFCA) of the pulmonary veins attached to the left atrium. RFCA is usually performed under fluoroscopic (X-ray) image ...
Complemental Use of Multiple Cameras for Stable Tracking of Multiple Markers
VMR '09: Proceedings of the 3rd International Conference on Virtual and Mixed Reality: Held as Part of HCI International 2009In many applications of Augmented Reality (AR), rectangular markers are tracked in real time by capturing with cameras. In this paper, we consider the AR application in which virtual objects are displayed onto markers while the markers and the cameras ...
Impact of augmented-reality improvement in ablation catheter navigation as assessed by virtual-heart simulations of ventricular tachycardia ablation
Abstract BackgroundRecently, an augmented reality (AR) solution allows the physician to place the ablation catheter at the designated lesion site more accurately during cardiac electrophysiology studies. The improvement in ...
Graphical abstractDisplay Omitted
Highlights- Assessment of catheter navigation accuracy provided by AR guidance by virtual heart.






Comments