Microsoft HoloLens & Healthcare Industry Deck

Thinking about mixed reality applications in health

What are your critical business objectives?

How do you try to save costs?

How do your physicians collaborate?

How do you train your staff?

What is your process for determining the layout of medical spaces such as operating rooms?

How do you share information? Apprenticeship / Training Pearson

HoloPatient

HoloPatient is a mixed reality application that helps to solve real problems in healthcare education by providing standardized patient experiences for medical education, nurse education, and paramedic education, amongst others disciplines.

“This technology would enable me to standardize the See the press release learner experience and make sure everyone gets the same attention.” A Tutor from Texas Tech University (TTU) See the project video

Developed by Pearson Digital Surgery

HoloPatient

Hololens interactive training solution for External Fixation of Tibial fracture. Learning Objectives include: Spatial awareness of radiation exposure, Anatomy and safe incision zones, Safe zones for screw insertion, , Angulation of screw insertion, Familiarity with devices such as drill, frame and C-Arm.

“This could improve the quality of education for surgeons.” “Potential to reduce training time and associated costs.” Kostas See the press release Mihail - Fellow Orthopaedic Surgeon

See the project video

Developed by Digital Surgery Fundamental VR

Multi MR for HoloLens

World's first multi-person shared healthcare educational holographic experience. Each user interacts with the same shared hologram, individually manipulating as they require. Education resource that makes great use of holographic sharing and synchronisation.

“It works very well, it’s a nice model, very elegant” See the website Shafi Ahmed, Surgeon at the Royal London Hospital See the project video

Developed by Fundamental VR CAE Healthcare

V i m e d i x A R

VimedixAR is an ultrasound simulator. Freed from the limits of a 2D environment inside a monitor, healthcare professionals can display, enlarge, and rotate realistic-looking anatomical parts and can witness, in real time, the ultrasound beam as it cuts through human anatomy. “We are on the cusp of a new frontier in simulation for healthcare (…) We look forward to offering it as a key See the press release training solutions technology to our industry partners.” See the project video Dr. Robert Amyot, president of CAE Healthcare

Developed by CAE Healthcare CAE Healthcare

L u c i n a A R

LucinaAR is a wireless childbirth simulator with validated, integrated maternal-fetal physiology for training on all the stages of delivery and the emergency scenario. Clinical learners can gain an unprecedented view of anatomy as they learn to manage a shoulder dystocia delivery. “CAE LucinaAR delivers a breakthrough simulation training experience that allows learners to see the anatomy inside See the press release the patient simulator” See the project video Dr. Robert Amyot, president of CAE Healthcare

Developed by CAE Healthcare CWRU

HoloAnatomy

Case Western Reserve University and the Cleveland Clinic partnered with to transform the way medical, dental and nursing students learn about the human body. With holography, students can cut into a virtual, 3D human body to understand the intricacies of and connections among all of its systems. “As our faculty and students continue to develop and refine the HoloLens-based anatomy curriculum, they identify new ways the See the press release technology can both deepen and accelerate learning.” See the project video President Barbara R. Snyder

Developed by CWRU Oslo Hospital

In collaboration with Sopra Steria

Oslo University Hospital, in collaboration with Sopra Steria, developed a Surgical Navigation system at the Intervention Centre. The goal is to improve surgery of liver cancer and heart deformities by visualizing the existing 3D model of the actual organ in Microsoft HoloLens. The system is also used by cardiologists involved in treatment of congenital heart disease. “When treating a liver cancer, one of the results of the new technique is that more of the healthy liver tissue can be left behind, which should See the press release increase the patients' ability to withstand more surgery in the course of See the project video their treatment” Bjørn Edwin, surgeon at Oslo University Hospital

Developed by Oslo Hospital & Sopra Steria SphereGen

Learning Heart

‘Learning Heart’ assists students in understanding the elements of the heart. As a study aid and teaching tool, this application can be used individually or collaboratively by multiple HoloLens users. 3D holograms can be traversed around and viewed from any position and angle.

“9 or 10 medical students sitting around, collaborating See the press release about an object, we decided why not make it a 3D

object?” Ted Dinsmore, Managing Partner SphereGen See the project video

Developed by SphereGen UCL & UCLH

PEACH Reality Project

PEACH is an app for caretakers to view, create, and modify existing holographic patient cases, and invite colleagues to collaborate on certain cases. Surgeons use these 3D anatomical holograms to plan for complicated surgeries and to help patients get a clearer picture and better understanding of their own bodies "The plan is to use the technology to help surgeons understand the specific anatomy and condition of a patient. When wearing the See the press release HoloLens, surgeons will be able to see an image of the patient’s See the project video organs.“ Dr. Ramachandran, Consultant Radiologist of UCL

Developed by UCL and UCLH UPSA

UPSA developed training programs for their new teammates, as well as their most experimented employees of their production site in Agen. The HoloLens app enables the maintenance staff to become more familiar with equipment without affecting productivity. "5 minutes on our application were therefore all that were needed to have a 1st look on the content of a 50-page See the press release instruction manual. It is definitely a time & energy saving.“ See the project video Patrice Cassignard, HoloForge Interactive Producer

Developed by HoloForge Interactive Collaboration / Remote Assistance ApoQlar

V i r t u a l S u r g e r y Intelligence

VSI patient education is the smartest way to inform patients about their disease and its progression, about treatment and also surgical procedures through 3D visuals and operation procedures together through multiple headsets.

“My patients feel more informed and educated, are less afraid of the surgery, and are also more confident in me who has given the indication See the website for their surgery.“ See the project video Dr. Patrick House, Epileptologist and Senior Physician at the Epilepsy Center Hamburg

Developed by Apo-Qlar C a r n a l i f e

MedApp is offering Telemedicine and Mixed Reality solutions for healthcare providers with a proven track record of assisting in real-life cases. We use HoloLens to visualize patients' medical images as interactive holograms. Carna Life telemedical system is based on using high-end technologies supported with 3D/4D rendering and predictive analytics. In contrast to most existing XR rendering , MedApp developed advanced volumetric rendering technology preserving See the website full quality of the 3D visualizations during 3D UX interaction and is independent of imaging modality used for generating the data. See the project video

Developed by MedApp Exelus

N o m a d e e c

Exelus telemedicine platform Nomadeec leverages the gesture and voice-based commands of the HoloLens to give practitioners access to customizable modules for patient assessments, clinical exams, and patient profiles. It offers paramedics and EMTs a new tool for diagnosis and treatment of patients in the field. "We believe that this kind of tool is making the difference to provide better and faster medical decision, and to improve patient care See the press release and patchway, especially in medical desert and critical area” See the project video Xavier Maurin, Chief Executive Officer Exelus

Développé par HoloForge Interactive AP-HP

AP-HP conducted a live surgery assisted by TeraRecon medical holographic platform leveraging Azure GPU and HoloLens. They developed a complete end-to-end solution from the patient surgery planning up to the real-time streaming of the real patent image data (pre- operative 3D CT scan).

"The Grail for a doctor is to see what his eye can not visualize: the patient's skeleton in every detail (...) All the help that could be desired See the press release in a surgical operation becomes a reality” See the project video Thomas Gregory, chirurgien orthopédiste à l'hôpital Avicenne

Developed by TeraRecon and Vizua Gregorio Marañón

H o l o S u r g

The General Hospital Universitario Gregorio Marañón in Madrid, together with Exovite, launched a project in which HoloLens was used to assist surgeons with the removal of malignant muscle tumours. The system (HoloSurg) consists of a virtual layout of interactive panels, overlaid in a surgeon’s real-world view. The Gregorio Marañón Hospital has currently started using this system in trauma and orthopaedic department capacities – both areas in See the press release which the manipulation of 3D patient models for precise planning and See the project video reconstruction is vital.

Developed by Exovite HoloEyes

Holoeyes makes customized models for patient’s organs. They helped perform a holographic surgical navigation using HoloLens for viewing the patient-specific 3D anatomical polygon models in robotic prostatectomy for prostatic cancer. They also created a patient-based educational simulation system for minimally invasive surgery. "Doctors are saying that HoloEyes is very useful and that it reduces training costs and the time it takes to communicate. Our goal is to See the website make archival patient data. So, it helps poorer Asian countries to See the project video train their young doctors. ” Naoji Taniguchi CEO and CTO HoloEyes

Developed by HoloEyes Medtronic

Medtronic wanted to enhance the operating room experience by putting data at physicians’ fingertips with minimal training on new technologies. Microsoft created an application for physicians to visualize their pre-operation planning. This simplified workflows and reduced complications.

"Our hope is HoloLens will enable better outcomes for all patients, regardless of where they are treated and who is treating them.” Brian Craig, VP Strategy & Business Development

Developed by Microsoft Microsoft

C a r d i o l e n s

Cardiolens is a mixed reality system that allows non-contact physiological measurement of multiple people in real-time. The physiological signals are visualized in the real-world allowing the wearer to see magnified blood perfusion and vital signs in real-time.

“Surgeons could see whether a transplanted organ/tissue has blood flowing to it. Physical trainers would be able to see if athletes are in See the press release their ‘zone’. People could increase their awareness of their See the project video physiological impact on others.”

Developed by Next Motion

Next Motion and Transition Technologies PSC developed an app to guide the surgeon through aesthetic procedures. With the help of a face recognition engine, the application superimposes a 3D hologram on the patient’s face and tracks the patient’s movement for continuous fit, allowing the surgeon to see veins, face muscles and needle injection points for Botox. “This innovative product created in the result of the collaboration between Transition Technologies PSC and Next Motion considerably See the press release decreases the risk of complications during procedures See the project video simultaneously improving their effectiveness” TTPSC Press Release

Developed by Nextmotion & TTPSC Novarad

O p e n S i g h t

Novarad created OpenSight to render patient studies into 3D and present them in an interactive manner accurately overlaid directly onto the patient’s body. This uses technologies including 3D imaging, advanced segmentation and rendering, registration, motion correction, virtual tools and 3D annotation technologies. “It offers a true, life-size rendering with exact alignment and orientation, which is valuable for medical education, research and, of See the website course, surgery.” See the project video Steve Cvetko, director of Research and Development at Novarad

Developed by Novarad Revinax

Revinax introduced mixed reality during live surgery. The surgical procedure was performed under the guidance of Dr Lonjon, a neurosurgeon from the Montpellier University Hospital in France. During the procedure, the surgical team was equipped with HoloLens which provided extra information, such as the patient imagery, throughout the surgery. “This is the perfect tool for any surgery. I can create my own tutorials to deliver them to students before surgery. The patient imagery and See the website planning feature also avoids unnecessary distractions: we now no longer See the project video need to check these data on the computer“ Dr Nicolas Lonjon

Developed by Revinax Scopis

Holographic Navigation Platform

Scopis created the Holographic Navigation Platform to offer greater precision and speed to surgeons, and better outcomes to patients undergoing open and minimally-invasive spinal procedures. The system overlays the planned position of the pedicle screws onto the patient in the surgeon’s field of vision using the mixed-reality technology. “Integrating mixed-reality tools into surgery is a huge technological advancement toward enhancing a surgeon’s See the website vision and may provide greater benefits to patients.” Christian Woiciechowsky, Chief of Clinic at Vivantes Humboldt

Developed by Scopis Silver Chain

Enhanced Medical Mixed Reality

EMMR is a new Enhanced Medical Mixed Reality interface. It uses mixed reality technology to combine , projected holograms and video conferencing, allowing nurses, clinicians and clients better access to information and services.

“This new application will give clients greater confidence to live at home, with the knowledge that clinical staff can access specialists, as See the press release well as the ability to share real time consultations with family members See the project video anywhere in the world” Christopher McGowan CEO Silver Chain

Developed by SphereGen SphereGen

DICOM Director

‘DICOM Director’ is a full product suite designed to enable communication and collaboration between different medical practices. Radiologists and doctors can remotely view the series of scans through the HoloLens, an enlarged view of the selected scan (which they can scroll through), and the 3D model reconstruction from the scans.

“DICOM Director leverages the 3D capabilities See the website of mixed and , which allows viewers to see

3D objects in 3D space.” DICOM Press Release See the project video

Developed by SphereGen Communication / Customer Engagement Stryker

Stryker Communications designs state-of-the-art, customized operating rooms using its ByDesign 3D design software. Microsoft HoloLens extends the capabilities of the ByDesign software, bringing their extensive portfolio of digital 3D assets to life and allowing stakeholders to collaborate in ways they couldn’t before "Now that HoloLens is a part of our selling process, it's going to push us in ways we were not pushing ourselves before. Now we are actually See the press release able to make it real for customers, we are actually able to bring it to See the project video life" Keith Evans, Marketing Director Stryker

Developed by Stryker Communications Microsoft HoloLens & Mixed Reality Thank you