Preparing for Conjoined Twins Separation Through Virtual Reality

Proceedings of the 2018 Design of Medical Devices Conference DMD2018 April 9-12, 2018, Minneapolis, MN, USA

DMD2018-6895 Downloaded from http://asmedigitalcollection.asme.org/BIOMED/proceedings-pdf/DMD2018/40789/V001T08A009/2787793/v001t08a009-dmd2018-6895.pdf by guest on 30 September 2021

PREPARING FOR CONJOINED TWINS SEPARATION THROUGH VIRTUAL REALITY

Bethany Juhnke, MS Alex Mattson, BS Daniel Saltzman, MD, PhD Earl E. Bakken Medical Visible Heart Laboratory Department of Surgery Devices Center University of Minnesota University of Minnesota University of Minnesota Minneapolis, Minnesota, USA Minneapolis, Minnesota, USA Minneapolis, Minnesota, USA

Anthony Azakie, MD Eric Hoggard, MD Matthew Ambrose Department of Surgery Department of Radiology Department of Pediatrics University of Minnesota University of Minnesota University of Minnesota Minneapolis, Minnesota, USA Minneapolis, Minnesota, USA Minneapolis, Minnesota, USA

Arthur Erdman, PhD Paul Iaizzo, PhD Gwenyth Fischer, MD Earl E. Bakken Medical Visible Heart Laboratory Department of Pediatrics Devices Center University of Minnesota University of Minnesota University of Minnesota Minneapolis, Minnesota, USA Minneapolis, Minnesota, USA Minneapolis, Minnesota, USA

BACKGROUND Advances in technology are making virtual reality (VR) available BLUE RED for many different interests. Inexpensive commercially available Twin Twin hardware can be setup at home [1,2], while corporations are using VR to design mechanical systems and train pilots [3,4]. However, limited application is seen in the medical field. Most medical VR simulation focus on medical training, by incorporating anatomical models, physics models, haptics, and visualization to recreate surgical procedures [4-6]. These simulations teach foundational technical skills and show value for preoperative planning and image-guided surgery [4,7]. Simulations provide opportunities to develop surgical plans [7], and practice teamwork skills [8]. Studies have shown that expenses of implementing VR technology can be offset by reduced operating room time [5] and s can shape the operating room of the future [6]. Procedural planning using VR shows positive results for patient outcomes. One study looking at VR use for procedural planning found an increase in operational success, a decrease in 30-day mortality and Figure 1. The heart of the RED twin was completely developed with all four an estimated cost savings by incorporating 3D imaging [9]. A second chambers functioning properly and modeled as oxygenated (pink) and study saw increase confidence in 14 of 16 study participants when deoxygenated (purple) sides of the heart. The BLUE twin’s heart had three virtual reality rehearsals were used prior to the procedure [5]. chambers and therefore only one model was created (blue). Conjoined twins are very unique cases that require advanced planning to ensure the wellbeing of both patients. The separation of METHODS craniopagus conjoined twins in 1997 is the first record of using VR for Imaging. Individual computed tomography angiograms (CTA) preoperative separation planning [6]. The medical team used VIVIAN, were captured of each twin with contrast injected. The scans were a Dextroscope-based VR environment designed for neurosurgeries. coded as RED baby and BLUE baby The twins were imaged at a The technology assisted with three craniopagus conjoined twins windowing level of 210, a window width of 1040 and slice thickness separations from 1997 to 2004 [6,10,11]. VR technology presented the of 600 μm. spatial relationships between anatomy and pathology to simulate the Segmentation. Mimics [12] software was used to segment and techniques needed during the surgery [6]. analysis the twins anatomical data. The cardiac blood volume of the In summary, we present the first case to our knowledge of VR used contrast-injected twin, lungs and thoracic skeletal anatomy were to assist in the separation planning of thoraco-omphalopagus conjoined modeled for each twin. The red twin’s four-chamber heart was twins; a connection at the chest, that includes sharing a heart and may modeled as the oxygenated left side and the deoxygenated right side. also involve sharing their liver and digestive system.

1 Copyright © 2018 ASME The blue twin’s three-chamber heart remained as one model. Cardiac, immediately prompted the doctors to reconsider the orientation of the lungs and skeletal anatomies for each twin were aligned in the twins during the surgery. software 3-matic [13]. Initially, the cardiac anatomies were juxtaposed Accessing and stopping the flow between the twin’s hearts would by aligning the thoracic cage of the blue twin from each scan. be one of the first steps in the lengthy separation procedure. The After discussion with the clinical team, the constructed models surgical team decided to flip the orientation of the twins to have the were modified. Matching the hepatic venous vasculature across both blue twin on the left and the red twin on the right. This orientation the scan of the red baby and the blue baby realigned cardiac would allow for a smaller incision to ensure the twin’s stabilization

anatomies. This alignment represented a more accurate depiction of during the separation of blood flow between their two hearts. Downloaded from http://asmedigitalcollection.asme.org/BIOMED/proceedings-pdf/DMD2018/40789/V001T08A009/2787793/v001t08a009-dmd2018-6895.pdf by guest on 30 September 2021 the anatomy. The hypothesized communication between atria was revealed after alignment, joining the lateral right atrial protrusion of the blue twin to the right atrium of the red twin. INTERPRETATION Once both cardiac blood volumes were modeled, a surface Virtual reality provides opportunities to improve the surgical thickness around the blood volume was created and blood volume was planning process, particularly for complex pediatric and neonatal subtracted to create hollow models. The lungs and skeletons were operative procedures. Medical professionals can collaboratively plan modeled as solid models. The final models were exported as stereo procedures while visualizing the same anatomical reconstruction of a lithography files (STL). patient’s anatomy. Medical devices can be accurately sized to patients Visualization. The STL models were loaded into MeshLab [14] and necessary surgical adaptations can be explored prior to the and assigned colors. The models for the red twin were colored in warm procedure. colors; while the blue twin’s models were colored in cool colors. The Medical imaging algorithm advancements will increase the models were exported as object files (OBJ) with corresponding accessibility of these techniques for surgical planning. Additional material files (MTL). A scene file was created and loaded into the improvements in algorithms for visualization to analyze DICOM data stereoscopic display [15] available at the University of Minnesota, Earl will enable medical professionals to view patient-specific anatomical E. Bakken Medical Device Center. Active shutter glasses were used to models. Allowing for a translation of the information virtually to view the models, as a touch display could rotate, translate and hide provide remote surgical planning opportunities. models. Overall, these visualization technologies will decrease the cost of healthcare in the foreseeable future. Medical professionals will be able to make informed decisions about a patient’s diagnosis and care based RESULTS on patient specific anatomical visualization. Patients will receive more Members of the general surgery and cardiac surgery teams accurate diagnoses in quicker timeframes to reduce the cost of each reviewed the anatomical visualizations. The first viewing confirmed individual’s overall healthcare, creating a more efficient and effective that the anatomy was segmented correctly. healthcare system. Atrial communication. The working clinical hypothesis was confirmed through the visualization that an atrial communication allowed free blood flow between the two hearts. This was evidenced REFERENCES by a close coupling of each twin’s p-wave as seen on EKG (i.e. one 1. Oculus Rift. https://www.oculus.com/rift/ twin’s atrial contraction was driven by the other twin’s atrial 2. HTC Vive. https://www.vive.com/us/ contraction), as well as increased plasma Brain Naturetic Peptide 3. Noon, C., Zhang, R., Winer, E., Oliver, J., Gilmore, B., & Duncan, (BNP) levels seen in the red twin. J. (2012). A system for rapid creation and assessment of Altering Surgical Planning. During the first viewing, members of conceptual large vehicle designs using immersive virtual reality. the surgical team discussed the best view of the anatomical models. Computers in Industry. 63(5):1-13. The teams preferred models that presented heart cavities surfaces. This doi:10.1016/j.compind.2012.02.003. visualization presented the perspective of placing a camera within the 4. Chan, S., Conti, F., Salisbury, K., & Blevins, N. (2013). Virtual anatomy. Reality Simulation in Neurosurgery: Technologies and Evolution. Neurosurgery. 72(51):A154-A164. doi: 10.1227/NEU.0b013e3182750d26. 5. Locketz, GD., Lui, JT., Chan, S., Dort, JC., Youngblood, P., & Blevins, NH. (2017). Anatomy-Specific Virtual Reality Simulation in Temporal Bone Dissection: Perceived Utility and Impact on Surgeon Confidence. Otolaryngology–Head and Neck Surgery. 156(6):1142-1149. doi:10.1177/0194599817691474. 6. Nowinski, W. (2005). Virtual reality in brain interventions: models and applications. Proceedings of the 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference. Shanghai, China. doi: 10.1109/IEMBS.2005.1615381. Atrial 7. Ryu, WHA., Dharampal, N., Mostafa, AE., Sharlin, E., Kopp, G., Communication Jacobs, WB., Hurlbert, RJ., Chan, S., & Sutherland, GR. (2017). Systematic Review of Patient-Specific Surgical Simulation: Toward Advancing Medical Education. Journal of Surgical Figure 2. The atrial communication was viewed by panning through the twin’s Education. 1-11. doi:10.1016/j.jsurg.2017.05.018. anatomy, confirming the surgical orientation of the BLUE twin on the left and 8. Simpao, AF., Wong, R., Ferrara, TJ., Hendrick, HL., Schwartz, the RED twin on the right. AJ., Snyder, TL., Tharakan, SJ., & Bailey, PD Jr. (2014). From Simulation to Separation Surgery: A Tale of Two Twins. The second viewing by the surgical team was in preparation for the Anesthesiology. 120(1):110. doi: surgery. The team had decided to orient the twins with the red twin on 10.1097/ALN.0b013e31828e13d6. the left and the blue twin on the right. Post separation the blue twin 9. Analbers, M. (2016). Its Heart to See: An Early Health Technology with the congenital defect would be moved to another operating room Assessment of Rendering 3D-Images prior to Transcatheter Aortic for additional procedures. The twin’s anatomy was presented in the Valve Implantation. Universiteit Twente. visualization in this proposed procedural orientation, including hearts, 10. Goh, KY. (2004) Separation surgery for total vertical craniopagus lungs and skeletal systems. twins. Childs Nervous System. 20(8-9):567-575. doi: The surgical team’s first objective was to view the atrial 10.1007/s00381-004-0978-3. communication of blood flow between the two hearts. The model was 11. Logan, G. Separate Fates. John Hopkins Magazine. 2005. rotated 180 degrees to accommodate the view of this connection and http://pages.jh.edu/~jhumag/0205web/separate.html

2 Copyright © 2018 ASME 12. Mimics [Computer software]. Materialize, Belgium. 15. Coffey, D., Malbraaten, N., Bao Le, T., Borazjani, I., Sotiropoulos, http://www.materialise.com/en/medical/software/mimics F., Erdman, AG., & Keefe, DF. (2012). Interactive Slice WIM: 13. 3-matic [Computer software]. Materialize, Belgium. Navigating and Interrogating Volume Data Sets Using a http://www.materialise.com/en/software/3-matic. Multisurface, Multitouch VR Interface. IEEE Transactions on 14. Meshlab. [Computer software]. Institute of the National Research Visualization and Computer Graphics. 18(10):1614-1626. doi: Council, Italy. http://www.meshlab.net/ 10.1109/TVCG.2011.283.

Downloaded from http://asmedigitalcollection.asme.org/BIOMED/proceedings-pdf/DMD2018/40789/V001T08A009/2787793/v001t08a009-dmd2018-6895.pdf by guest on 30 September 2021