Projects

How the AIM Lab is transforming medical education

AIMProject1.jpg In 2017, Dr. Matthew Bramlet, director of the AIM Lab and his team of engineers developed software capable of translating digital formats of medical scans into virtual reality for medical decision making, pre-surgical planning and patient education. The idea was to eliminate the need to 3D print a physical model and reduce the time it takes to view a complete image. It was also Dr. Bramlet’s belief that VR would enable clinicians to explore and experience the anatomy in ways they’ve never been able to before.

“We had some people that blew it up to the size of a cave and would walk through and orient themselves to the anatomy and then have that moment where everything sort of clicked into place in their mind,” said Dr. Bramlet who is also a pediatric cardiologist at the OSF HealthCare Children’s Hospital of Illinois. “Others would keep it down to the size they were looking for and cut through it with cut planes. Since it wasn’t a physical model, there were infinite opportunities for them to look into it.”

In watching these clinicians interact with the 3D anatomy models within VR, he noticed they were all instinctively narrating what they were seeing within the virtual space and sharing discoveries along the way. That’s when the AIM Lab realized they had created a new form of medical education. With that came the commercial spinoff of Enduvo, a platform that allows clinical educators to build lectures in virtual reality, using nothing more than 3D anatomic models, video clips and diagrams. The VR software is now being used by government, manufacturing and industrial customers.

Tackling medical school training challenges with VR

AIMProject2.jpg Before the first cases of COVID-19 hit the United States, the AIM Lab was working with researchers from the University of Illinois College of Medicine Peoria (UICOMP) and the Jump Trading Simulation & Education Center to teach medical students and health professionals outside of the hospital or classroom.

“Medical students can’t always participate in bedside rounds, assist in surgeries or learn from real-life scenarios where they have to diagnose critically-ill patients,” said Dr. Matthew Bramlet, director of the AIM Lab. “So, we wanted to investigate if we could give our students that same experience using virtual reality.”

Dr. Bramlet and other researchers, including Dr. Teresa Riech built two cases in VR where medical students would have to diagnose and treat an adult with an unstable heart rhythm and a child who had difficulty breathing. The team then tasked 20 volunteer learners to go through each case at their own pace. Following the VR study, results showed: 

  • Learners rated VR equal to or better than traditional lecture.
  • Medical students took the opportunity to review the material carefully, remaining in the learning environment well beyond recorded time (not an option in traditional lecture).
  • The Immersive nature minimizes distraction. Not one student checked their phone to answer a text or look at a notification while wearing the VR headset.
  • The cases recorded separately by different instructors resulted in final modules that were within 8 seconds in length suggesting the template could be used for future case development.

The training also helped build students’ confidence. Before the lessons, only 5% expressed complete confidence in their ability to assess and provide the right treatment. 45% reported feeling completely confident in their skills after the VR lessons, 55% of students felt somewhat confident, and no students rated themselves as ‘not at all confident’. This research was presented at the Association of American Medical Colleges 2020 Annual Meeting.

Using VR to fight cancer

AIMProject3.jpg Surgical oncologist Dr. Sonia Orcutt first learned about the 3D modeling capabilities of Jump AIM through her husband, who is a pediatric cardiologist alongside Dr. Bramlet.

“Like pediatric cardiac surgeons, we face the same challenges of not knowing what we are going to see in the operating room until we get there,” said Dr. Orcutt. “So, this piqued my interest in wanting to study the feasibility of using VR to see complex abdominal tumors for pre-surgical planning.”

Dr. Orcutt worked with Dr. Bramlet to convert CT scans of previous surgical cases into VR and discovered that viewing the images in this technology would’ve helped her better define her operating plans. She now regularly uses VR to view complex cases where she can’t distinguish the relationship of a tumor with other structures, such as blood vessels or other major organs.

In one situation, she and her colleague were having a difficult time determining a plan of attack on a large tumor that was displacing a patient’s liver, inferior vena cava and kidney. 

“When we placed our images in VR, we got a better understanding of the size and location of this tumor,” said Dr. Orcutt. “We ended up changing our incision to be a little larger, so we could have control of the blood vessels. We didn’t want to run into any significant hemorrhaging issues or anything else that was unsafe.” 

Thanks to continued funding for the VR program, Dr. Orcutt is working on a formal study on whether the technology, in addition to standard imaging, improves a physician’s ability to define the extent of how much tissue should be cut out in a surgery. This can open the door to using this technology for a variety of tumors beyond the abdominal cavity.