Abstract
The focus of this article is on the adoption of immersive and haptic simulators for training of medical residents in a surgical process called Less Invasive Stabilization System (LISS) plating surgery. LISS surgery is an orthopedic surgical procedure to treat fractures of the femur bone. Development of such simulators is a complex task which involves multiple systems, technologies, and human experts. Emerging Next Generation Internet technologies were used to develop the standalone on-line haptic-based simulator accessible to the students 24/7. A standalone immersive surgical simulator was also developed using HTC Vive. Expert surgeons played an important role in developing the simulator system; use cases of the target surgical processes were built using a modeling language called the engineering Enterprise Modeling Language (eEML). A detailed study presenting the comparison between the haptic-based simulator and the immersive simulator has been also presented. The outcomes of this study underscore the potential of using such simulators in surgical training.
- B. Tolsdorff, A. Pommert, K. H. Höhne, A. Petersik, B. Pflesser, U. Tiede, and R. Leuwer. 2010. Virtual reality: A new paranasal sinus surgery simulator. The Laryngoscope, 120, 2, 420--426.Google Scholar
Cross Ref
- K. S. Choi, S. Soo, and F. L. Chung. 2009. A virtual training simulator for learning cataract surgery with phacoemulsification. Computers in Biology and Medicine, 39, 11, 1020--1031. Google Scholar
Digital Library
- G. Echegaray, I. Herrera, I. Aguinaga, C. Buchart, and D. Borro. 2014. A brain surgery simulator. IEEE Computer Graphics and Applications, 34, 3, 12--18.Google Scholar
Cross Ref
- C. Luciano, P. Banerjee, and T. DeFanti. 2009. Haptics-based virtual reality periodontal training simulator. Virtual Reality, 13, 2, 69--85.Google Scholar
Digital Library
- Y. Shi, Y. Xiong, X. Hua, K. Tan, and X. Pan. 2015. Key techniques of haptic related computation in virtual liver surgery. In 2015 8th International Conference on Biomedical Engineering and Informatics (BMEI). IEEE, 355--359.Google Scholar
- L. Yu, T. Wang, W. Wang, Z. Wang, and B. Zhang. 2013. A geometric modeling method based on OpenGL in virtual gallbladder surgery. In 2nd International Conference on Computer Science and Electronics Engineering. Atlantis Press.Google Scholar
- T. M. Peters, C. A. Linte, J. Moore, D. Bainbridge, D. L. Jones, and G. M. Guiraudon. 2008. Towards a medical virtual reality environment for minimally invasive cardiac surgery. In International Workshop on Medical Imaging and Virtual Reality. Springer, Berlin, 1--11. Google Scholar
Digital Library
- T. S. Sørensen, S. V. Therkildsen, P. Makowski, J. L. Knudsen, and E. M. Pedersen. 2001. A new virtual reality approach for planning of cardiac interventions. Artificial Intelligence in Medicine, 22, 3, 193--214. Google Scholar
Digital Library
- T. Berlage, A. Schmitgen, C. Schmitz, and A. Welz. 2001. Simulation and planning of minimally invasive coronary artery bypass surgery. In International Congress Series. Elsevier, 68--72.Google Scholar
- V. T. Le and S. Nahavandi. 2010. A haptic training environment for the heart myoblast cell injection procedure. In 11th International Conference on Control Automation Robotics 8 Vision (ICARCV). IEEE, 448--452.Google Scholar
- J. Ren, R. V. Patel, K. A. McIsaac, G. Guiraudon, and T. M. Peters. 2008. Dynamic 3-D virtual fixtures for minimally invasive beating heart procedures. IEEE Transactions on Medical Imaging, 27, 8, 1061--1070.Google Scholar
Cross Ref
- R. Yu, S. Zhang, P. Chiang, Y. Cai, and J. Zheng. 2010. Real-time and realistic simulation for cardiac intervention with GPU. In 2nd International Conference on Computer Modeling and Simulation (ICCMS’10). IEEE, 68--72. Google Scholar
Digital Library
- G. Azzie, J. T. Gerstle, A. Nasr, D. Lasko, J. Green, O. Henao, and A. Okrainec. 2011. Development and validation of a pediatric laparoscopic surgery simulator. Journal of Pediatric Surgery, 46, 5, 897--903.Google Scholar
Cross Ref
- S. A. Seixas-Mikelus, T. Kesavadas, G. Srimathveeravalli, R. Chandrasekhar, G. E. Wilding, and K. A. Guru. 2010. Face validation of a novel robotic surgical simulator. Urology, 76, 2, 357--360.Google Scholar
Cross Ref
- K. Makiyama, M. Nagasaka, T. Inuiya, K. Takanami, M. Ogata, and Y. Kubota. 2012. Development of a patient specific simulator for laparoscopic renal surgery. International Journal of Urology, 19, 9, 829--835.Google Scholar
Cross Ref
- T. P. Grantcharov, V. B. Kristiansen, J. Bendix, L. Bardram, J. Rosenberg, and P. Funch‐Jensen. 2004. Randomized clinical trial of virtual reality simulation for laparoscopic skills training. British Journal of Surgery, 91, 2, 146--150.Google Scholar
Cross Ref
- R. Aggarwal, I. Balasundaram, and A. Darzi. 2008. Training opportunities and the role of virtual reality simulation in acquisition of basic laparoscopic skills. Journal of Surgical Research, 145, 1, 80--86.Google Scholar
Cross Ref
- J. Torkington, S. G. Smith, B. I. Rees, and A. Darzi. 2000. The role of simulation in surgical training. Annals of the Royal College of Surgeons of England, 82, 2, 88.Google Scholar
- A. Sourin, O. Sourina, and H. T. Sen. 2000. Virtual orthopedic surgery training. IEEE Computer Graphics and Applications, 20, 3, 6--9. Google Scholar
Digital Library
- J. Qin, W. M. Pang, Y. P. Chui, T. T. Wong, and P. A. Heng. 2010. A novel modeling framework for multilayered soft tissue deformation in virtual orthopedic surgery. Journal of Medical Systems, 34, 3, 261--271.Google Scholar
Cross Ref
- S. L. Delp and J. P. Loan. 1995. A graphics-based software system to develop and analyze models of musculoskeletal structures. Computers in Biology and Medicine, 25, 1, 21--34.Google Scholar
Cross Ref
- M. D. Tsai, M. S. Hsieh, and S. B. Jou. 2001. Virtual reality orthopedic surgery simulator. Computers in Biology and Medicine, 31, 5, 333--351.Google Scholar
Cross Ref
- J. W. Park, J. Choi, Y. Park, and K. Sun. 2011. Haptic virtual fixture for robotic cardiac catheter navigation. Artificial Organs, 35, 11, 1127--1131.Google Scholar
Cross Ref
- The American Board of Orthopedic Surgery. Retrieved from https://www.abos.org/abos-surgical-skills-modules-for-pgy-1-residents.aspx.Google Scholar
- M. D. Tsai, C. S. Liu, H. Y. Liu, M. S. Hsieh, and F. C. Tsai. 2011. Virtual reality facial contouring surgery simulator based on CT transversal slices. In 5th International Conference on Bioinformatics and Biomedical Engineering (iCBBE). IEEE, 1--4.Google Scholar
- M. Vankipuram, K. Kahol, A. McLaren, and S. Panchanathan. 2010. A virtual reality simulator for orthopedic basic skills: A design and validation study. Journal of Biomedical Informatics, 43, 5, 661--668. Google Scholar
Digital Library
- P. Blyth, N. S. Stott, and I. A. Anderson. 2007. A simulation-based training system for hip fracture fixation for use within the hospital environment. Injury, 38, 10, 1197--1203.Google Scholar
Cross Ref
- S. Bayonat, M. García, C. Mendoza, and J. M. Fernandez. 2006. Shoulder arthroscopy training system with force feedback. In International Conference on Medical Information Visualisation-BioMedical Visualisation (MedVis'06).IEEE, 71--76. Google Scholar
Digital Library
- J. Petersson, K. L. Palmerius, H. Knutsson, O. Wahlstrom, B. Tillander, and M. Borga. 2008. Simulation of patient specific cervical hip fracture surgery with a volume haptic interface. IEEE Transactions on Biomedical Engineering, 55, 4, 1255--1265.Google Scholar
Cross Ref
- H. Sabri, B. Cowan, B. Kapralos, M. Porte, D. Backstein, and A. Dubrowskie. 2010. Serious games for knee replacement surgery procedure education and training. Procedia-Social and Behavioral Sciences, 2, 2, 3483--3488.Google Scholar
Cross Ref
- I. Kovler, L. Joskowicz, Y. A. Weil, A. Khoury, A. Kronman, R. Mosheiff, and J. Salavarrieta. 2015. Haptic computer-assisted patient-specific preoperative planning for orthopedic fractures surgery. International Journal of Computer Assisted Radiology and Surgery, 10, 10, 1535--1546.Google Scholar
Cross Ref
- M. D. Tsai, M. S. Hsieh, and C. H. Tsai. (2007). Bone drilling haptic interaction for orthopedic surgical simulator. Computers in Biology and Medicine, 37, 12, 1709--1718. Google Scholar
Digital Library
- O. Sourina, A. Sourin, and H. T. Sen. 2000. Virtual orthopedic surgery training on personal computer. International Journal of Information Technology, 6, 1, 16--29.Google Scholar
- M. X. Kong, Z. J. Du, L. N. Sun, L. X. Fu, Z. H. Jia, and D. M. Wu. 2006. A robot-assisted orthopedic telesurgery system. In 2005 27th Annual IEEE Conference Engineering in Medicine and Biology. IEEE, 97--101.Google Scholar
- L. Rosenblum M. Macedonia. 2000. Virtual orthopedic surgery training. IEEE Computer Graphics and Applications, 20, 3, 6--9. Google Scholar
Digital Library
- G. Burdea, V. Popescu, V. Hentz, and K. Colbert. 2000. Virtual reality-based orthopedic telerehabilitation. IEEE Transactions on Rehabilitation Engineering, 8, 3, 430--432.Google Scholar
Cross Ref
- M. A. Padilla-Castaneda, E. Sotgiu, A. Frisoli, M. Bergamasco, P. Orsini, A. Martiradonna, and C. Laddaga. 2013. A virtual reality system for robotic-assisted orthopedic rehabilitation of forearm and elbow fractures. In 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 1506--1511.Google Scholar
- M. Eriksson, H. Flemmer, and J. Wikander. 2005. Haptic simulation of the milling process in temporal bone operations. Studies in Health Technology and Informatics 111 (2005), 133--136.Google Scholar
- D. d'Aulignac, M. C. Cavusoglu, and C. Laugier. 1999. Modeling the dynamics of the human thigh for a realistic echographic simulator with force feedback. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Berlin, 1191--1198. Google Scholar
Digital Library
- T. Seth, V. Chaudhary, C. Buyea, and L. Bone. 2011. A virtual interactive navigation system for orthopedic surgical interventions. In 4th International Symposium on Applied Sciences in Biomedical and Communication Technologies, ACM, 71. Google Scholar
Digital Library
- W. I. Willaert, R. Aggarwal, I. Van Herzeele, N. J. Cheshire, and F. E. Vermassen. 2012. Recent advancements in medical simulation: patient-specific virtual reality simulation. World Journal of Surgery, 36, 7, 1703--1712.Google Scholar
Cross Ref
- C. Karaliotas. 2011. When simulation in surgical training meets virtual reality. Hellenic Journal of Surgery, 83, 6, 303--316.Google Scholar
Cross Ref
- J. P. Braman, R. M. Sweet, D. M. Hananel, P. M. Ludewig, and A. E. Van Heest. 2015. Development and validation of a basic arthroscopy skills simulator. Arthroscopy: The Journal of Arthroscopic 8 Related Surgery, 31, 1, 104--112.Google Scholar
Cross Ref
- C. Andersen, T. N. Winding, and M. S. Vesterby. 2011. Development of simulated arthroscopic skills: A randomized trial of virtual-reality training of 21 orthopedic surgeons. Acta orthopedica, 82, 1, 90--95.Google Scholar
- K. Rose and R. Pedowitz. 2015. Fundamental arthroscopic skill differentiation with virtual reality simulation. Arthroscopy: The Journal of Arthroscopic 8 Related Surgery, 31, 2, 299--305.Google Scholar
Cross Ref
- J. J. Stunt, G. M. M. J. Kerkhoffs, C. N. van Dijk, and G. J. M. Tuijthof. 2015. Validation of the arthros virtual reality simulator for arthroscopic skills. Knee Surgery, Sports Traumatology, Arthroscopy, 23, 11, 3436--3442.Google Scholar
- J. Qin, W. M. Pang, Y. P. Chui, T. T. Wong, and P. A. Heng. 2010. A novel modeling framework for multilayered soft tissue deformation in virtual orthopedic surgery. Journal of Medical Systems, 34, 3, 261--271.Google Scholar
Cross Ref
- Y. Lin, X. Wang, F. Wu, X. Chen, C. Wang, and G. Shen. 2014. Development and validation of a surgical training simulator with haptic feedback for learning bone-sawing skill. Journal of Biomedical Informatics, 48, 122--129. Google Scholar
Digital Library
- NASA TLX Test. Retrieved from https://humansystems.arc.nasa.gov/groups/TLX/downloads/TLX.pdf.Google Scholar
- A. Nahvi, M. Moghaddam, M. Arbabtafti, M. Mahvash, and B. Richardson. 2016. Virtual bone surgery using a haptic robot. International Journal of Robotics, Theory and Applications, 1, 1, 1--12.Google Scholar
- M. Citak, M. J. Gardner, D. Kendoff, S. Tarte, C. Krettek, L. P. Nolte, and T. Hüfner. 2008. Virtual 3D planning of acetabular fracture reduction. Journal of Orthopedic Research, 26, 4, 547--552.Google Scholar
Cross Ref
- L. Assassi, C. Charbonnier, J. Schmid, P. Volino, and N. Magnenat‐Thalmann. 2009. From MRI to anatomical simulation of the hip joint. Computer Animation and Virtual Worlds, 20, 1, 53--66. Google Scholar
Digital Library
- Y. Jun and S. Park. 2011. Polygon-based 3D surgical planning system for hip operation. International Journal of Precision Engineering and Manufacturing, 12, 1, 157--160.Google Scholar
Cross Ref
- D. Morris, C. Sewell, N. Blevins, F. Barbagli, and K. Salisbury. 2004. A collaborative virtual environment for the simulation of temporal bone surgery. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Berlin Heidelberg, 319--327.Google Scholar
- B. Chebbi, D. Lazaroff, F. Bogsany, P. X. Liu, L. Ni, and M. Rossi. 2005. Design and implementation of a collaborative virtual haptic surgical training system. In IEEE International Conference Mechatronics and Automation. IEEE, 315--320.Google Scholar
- P. V. Paiva, L. D. S. Machado, A. M. G. Valença, R. M. De Moraes, and T. V. Batista. 2016. Enhancing collaboration on a cloud-based CVE for supporting surgical education. In 2016 XVIII Symposium on Virtual and Augmented Reality (SVR). IEEE, 29--36.Google Scholar
- S. W. Tang, K. L. Chong, J. Qin, Y. P. Chui, S. S. M. Ho, and P. A. Heng. 2007. ECiSS: A middleware based development framework for enhancing collaboration in surgical simulation. In IEEE International Conference on Integration Technology (ICIT'07). IEEE, 15--20.Google Scholar
- C. Jay, M. Glencross, and R. Hubbold. 2007. Modeling the effects of delayed haptic and visual feedback in a collaborative virtual environment. ACM Transactions on Computer-Human Interaction (TOCHI), 14, 2, 8. Google Scholar
Digital Library
- E. Acosta and A. Liu. 2007. Real-time interactions and synchronization of voxel-based collaborative virtual environments. In 2007 IEEE Symposium on 3D User Interfaces. IEEE.Google Scholar
- P. Youngblood, P. M. Harter, S. Srivastava, S. Moffett, W. L. Heinrichs, and P. Dev. 2008. Design, development, and evaluation of an online virtual emergency department for training trauma teams. Simulation in Healthcare, 3, 3, 146--153.Google Scholar
Cross Ref
- B. R. A. Sales, L. S. Machado, and R. M. Moraes. 2011. Interactive collaboration for virtual reality systems related to medical education and training. Technology and Medical Sciences, 157--162.Google Scholar
- J. C. De Oliveira and N. D. Georganas. 2003. VELVET: An adaptive hybrid architecture for very large virtual environments. Presence: Teleoperators and Virtual Environments, 12, 6, 555--580. Google Scholar
Digital Library
- J. Qin, K. S. Choi, W. S. Poon, and P. A. Heng. 2009. A framework using cluster-based hybrid network architecture for collaborative virtual surgery. Computer Methods and Programs in Biomedicine, 96, 3, 205--216. Google Scholar
Digital Library
- R. Caceres and A. Friday. 2012. Ubicomp systems at 20: Progress, opportunities, and challenges. IEEE Pervasive Computing, 11, 1, 14--21. Google Scholar
Digital Library
- C. Mégard, F. Gosselin, S. Bouchigny, F. Ferlay, and F. Taha. 2009. User-centered design of a maxillo-facial surgery training platform. In 16th ACM Symposium on Virtual Reality Software and Technology. ACM, 265--266. Google Scholar
Digital Library
- G. Brandt, A. Zimolong, L. Carrat, P. Merloz, H. W. Staudte, S. Lavallee, and G. Rau. 1999. CRIGOS: A compact robot for image-guided orthopedic surgery. IEEE Transactions on Information Technology in Biomedicine, 3, 4, 252--260. Google Scholar
Digital Library
- J. Forsslund, E. L. Sallnas, and K. J. Palmerius. 2009. A user-centered designed FOSS implementation of bone surgery simulations. In EuroHaptics Conference, 2009 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics 2009. IEEE, 391--392. Google Scholar
Digital Library
- A. Jalote-Parmar and P. Badke-Schaub. 2008. Workflow integration matrix: A framework to support the development of surgical information systems. Design Studies, 29, 4, 338--368.Google Scholar
Cross Ref
- P. Jannin. 2013. Surgical process modeling: Methods and applications. In Presentation at the 2013 Medicine Meets Virtual Reality Conference (NEXTMED/MMVR20).Google Scholar
- A. Nemani, G. Sankaranarayanan, K. Roberts, L. Panait, C. Cao, and S. De. 2013. Hierarchical task analysis of hybrid rigid scope natural orifice translumenal endoscopic surgery (NOTES) cholecystectomy procedures. Studies in Health Technology and Informatics, 184, 293--297.Google Scholar
- J. Cecil, M. B. R. Kumar, A. Gupta, M. Pirela-Cruz, E. Chan-Tin, and J. Yu. 2016. Development of a virtual reality based simulation environment for orthopedic surgical training. In OTM Confederated International Conferences On the Move to Meaningful Internet Systems. Springer, 206--214.Google Scholar
- J. Cecil, A. Gupta, and M. Pirela-Cruz. 2018. An advanced simulator for orthopedic surgical training. International Journal of Computer Assisted Radiology and Surgery, 13, 2, 305--319.Google Scholar
Cross Ref
- Communication diagrams. Retrieved from http://agilemodeling.com/style/collaborationDiagram.htm.Google Scholar
- J. Cecil, A. Gupta, M. Pirela-Cruz, and P. Ramanathan. 2017. A cyber training framework for orthopedic surgery. Cogent Medicine, 4, 1, 1419792.Google Scholar
Cross Ref
- GENI. Retrieved from www.geni.net.Google Scholar
- FIRE. Retrieved from https://www.ict-fire.eu/.Google Scholar
- M. Berman, J. S. Chase, L. Landweber, A. Nakao, M. Ott, D. Raychaudhuri, and I. Seskar. 2014. GENI: A federated testbed for innovative network experiments. Computer Networks, 61, 5--23.Google Scholar
Digital Library
- Software Defined Networking. Retrieved from https://www.opennetworking.org/sdn-resources/sdn-definition.Google Scholar
- S. Wijewickrema, B. Copson, Y. Zhou, X. Ma, R. Briggs, J. Bailey, G. Kennedy, and S. O'Leary. 2017. Design and evaluation of a virtual reality simulation module for training advanced temporal bone surgery. In 2017 IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS). IEEE, 7--12.Google Scholar
Cross Ref
- James D. Watterson, Darren T. Beiko, James K. Kuan, and John D. Denstedt. 2002. A randomized prospective blinded study validating acquisition of ureteroscopy skills using a computer based virtual reality endourological simulator. The Journal of Urology, 168, 5, 1928--1932.Google Scholar
Cross Ref
- Schlickum Marcus Kolga, Leif Hedman, Lars Enochsson, Ann Kjellin, and Li Felländer-Tsai. 2009. Systematic video game training in surgical novices improves performance in virtual reality endoscopic surgical simulators: A prospective randomized study. World Journal of Surgery, 33, 11, 2360.Google Scholar
- Steam VR toolkit. Retrieved from https://partner.steamgames.com/vrlicensing.Google Scholar
- VRTK. Retrieved from https://vrtoolkit.readme.io/.Google Scholar
- Vive. Retrieved from https://www.vive.com/us/.Google Scholar
- E. G. G. Verdaasdonk, J. Dankelman, J. F. Lange, and L. P. S. Stassen. 2008. Transfer validity of laparoscopic knot-tying training on a VR simulator to a realistic environment: A randomized controlled trial. Surgical Endoscopy, 22, 7, 1636--1642.Google Scholar
Cross Ref
- N. R. Howells, H. S. Gill, A. J. Carr, A. J. Price, and J. L. Rees. 2008. Transferring simulated arthroscopic skills to the operating theatre: A randomised blinded study. Bone 8 Joint Journal, 90, 4, 494--499.Google Scholar
Index Terms
A Network-Based Virtual Reality Simulation Training Approach for Orthopedic Surgery
Recommendations
Computer-based virtual reality simulator for phacoemulsification cataract surgery training
Recent research in virtual reality indicates that computer-based simulators are an effective technology to use for surgeons learning to improve their surgical skills in a controlled environment. This article presents the development of a virtual reality ...
A Systematic Review on Orthopedic Simulators for Psycho-Motor Skill and Surgical Procedure Training
Precise simulators can replicate complete understanding of the models. In this survey, we focus on orthopedic simulators that are not only in replicating real-world models but also in educating with complete procedure: surgical, for instance. It covers ...
A Virtual Reality Based Simulation Environment for Orthopedic Surgery
Proceedings of the Confederated International Workshops on On the Move to Meaningful Internet Systems: OTM 2014 Workshops - Volume 8842Virtual reality simulators in medicine are becoming more widely used to train residents and interns. In this paper, we discuss the design of a Virtual Surgical Environment VSE for performing a class of orthopedic surgeries. The VSE focuses on providing ...






Comments