Augmented Reality: Clinical Use Scenarios and Latest Technologies

Dr. Hunt explains the differences between virtual reality (VR), augmented reality (AR), and mixed reality (MR) since there is increasing levels of overlap between virtual and real worlds with each category . He notes that all three are being explored in surgical fields, especially orthopedics and neurosurgery. Within IR, augmented reality can be used to adjust images and subtract out respiratory motion, making biopsies and ablations safer and more effective. Dr. Hunt became interested in AR when his PIGI Lab at the University of Pennsylvania needed 3D models to access liver tumors in experimental mice. Additionally, AR is a useful tool for planning difficult procedures and teaching interventional procedures to trainees across the globe.

Dr. Martin speaks about the intersection of medicine and industry. He directs research studies for Mediview, a company focused on bringing AR into medical imaging. Dr. Martin speaks about the important role that industry plays in commercializing an invention and getting it into operators’ hands. As larger companies enter the AR space, accessibility and user interfaces will improve. Additionally, the shift towards AR product development can guide future FDA regulations.

Dr. Gadodia’s engineering background made him excited to enter the AR space as resident at the Cleveland Clinic. He highlights applications of AR in the non-academic setting. Using a headset could increase procedural efficiency and access to care.

Finally, we discuss major shifts in industry and medicine that favor the increasing use of AR, such as industry’s need for clinician input in product development, the multitude of startups working on the same issues, and the overarching goal of patient safety.