{"id":3203,"date":"2023-10-05T13:50:53","date_gmt":"2023-10-05T13:50:53","guid":{"rendered":"https:\/\/salarydistribution.com\/machine-learning\/2023\/10\/05\/brains-of-the-operation-atlas-meditech-maps-future-of-surgery-with-ai-digital-twins\/"},"modified":"2023-10-05T13:50:53","modified_gmt":"2023-10-05T13:50:53","slug":"brains-of-the-operation-atlas-meditech-maps-future-of-surgery-with-ai-digital-twins","status":"publish","type":"post","link":"https:\/\/salarydistribution.com\/machine-learning\/2023\/10\/05\/brains-of-the-operation-atlas-meditech-maps-future-of-surgery-with-ai-digital-twins\/","title":{"rendered":"Brains of the Operation: Atlas Meditech Maps Future of Surgery With AI, Digital Twins"},"content":{"rendered":"
\n

Just as athletes train for a game or actors rehearse for a performance, surgeons prepare ahead of an operation.<\/p>\n

Now, Atlas Meditech is letting brain surgeons experience a new level of realism in their pre-surgery preparation with AI and physically accurate simulations.<\/p>\n

Atlas Meditech, a brain-surgery intelligence platform, is adopting tools \u2014 including the MONAI<\/a> medical imaging framework and NVIDIA Omniverse<\/a> 3D development platform \u2014 to build AI-powered decision support and high-fidelity surgery rehearsal platforms. Its mission: improving surgical outcomes and patient safety.<\/p>\n

\u201cThe Atlas provides a collection of multimedia tools for brain surgeons, allowing them to mentally rehearse an operation the night before a real surgery,\u201d said Dr. Aaron Cohen-Gadol, founder of Atlas Meditech and its nonprofit counterpart, Neurosurgical Atlas. \u201cWith accelerated computing and digital twins, we want to transform this mental rehearsal into a highly realistic rehearsal in simulation.\u201d<\/p>\n

Neurosurgical Atlas offers case studies, surgical videos and 3D models of the brain to more than a million online users. Dr. Cohen-Gadol, also a professor of neurological surgery at Indiana University School of Medicine, estimates that more than 90% of brain surgery training programs in the U.S. \u2014 as well as tens of thousands of neurosurgeons in other countries \u2014 use the Atlas as a key resource during residency and early in their surgery careers.<\/p>\n

Atlas Meditech\u2019s Pathfinder software is integrating AI algorithms that can suggest safe surgical pathways for experts to navigate through the brain to reach a lesion.<\/p>\n

And with NVIDIA Omniverse, a platform for connecting and building custom 3D pipelines and metaverse applications, the team aims to create custom virtual representations of individual patients\u2019 brains for surgery rehearsal.<\/p>\n

Custom 3D Models of Human Brains<\/b><\/h2>\n

A key benefit of Atlas Meditech\u2019s advanced simulations \u2014 either onscreen or in immersive virtual reality \u2014 is the ability to customize the simulations, so that surgeons can practice on a virtual brain that matches the patient\u2019s brain in size, shape and lesion position.<\/span><\/p>\n

\u201cEvery patient\u2019s anatomy is a little different,\u201d said Dr. Cohen-Gadol. \u201cWhat we can do now with physics and advanced graphics is create a patient-specific model of the brain and work with it to see and virtually operate on a tumor. The accuracy of the physical properties helps to recreate the experience we have in the real world during an operation.\u201d<\/p>\n

To create digital twins of patients\u2019 brains, the Atlas Pathfinder tool has adopted MONAI Label, which can support radiologists by automatically annotating MRI and CT scans to segment normal structures and tumors.<\/p>\n

\u201cMONAI Label is the gateway to any healthcare project because it provides us with the opportunity to segment critical structures and protect them,\u201d said Dr. Cohen-Gadol. \u201cFor the Atlas, we\u2019re training MONAI Label to act as the eyes of the surgeon, highlighting what is a normal vessel and what\u2019s a tumor in an individual patient\u2019s scan.\u201d<\/p>\n

<\/p>\n

\"\"<\/p>\n

<\/a><\/p>\n

With a segmented view of a patient\u2019s brain, Atlas Pathfinder can adjust its 3D brain model to morph to the patient\u2019s specific anatomy, capturing how the tumor deforms the normal structure of their brain tissue.<\/p>\n

Based on the visualization \u2014 which radiologists and surgeons can modify to improve the precision \u2014 Atlas Pathfinder suggests the safest surgical approaches to access and remove a tumor without harming other parts of the brain. Each approach links out to the Atlas website, which includes a written tutorial of the operative plan.<\/p>\n

\u201cAI-powered decision support can make a big difference in navigating a highly complex 3D structure where every millimeter is critical,\u201d Dr. Cohen-Gadol said.<\/p>\n

Realistic Rehearsal Environments for Practicing Surgeons\u00a0<\/b><\/h2>\n

Atlas Meditech is using NVIDIA Omniverse to develop a virtual operating room that can immerse surgeons into a realistic environment to rehearse upcoming procedures. In the simulation, surgeons can modify how the patient and equipment are positioned.<\/p>\n

Using a VR headset, surgeons will be able to work within this virtual environment, going step by step through the procedure and receiving feedback on how closely they are adhering to the target pathway to reach the tumor. AI algorithms can be used to predict how brain tissue would shift as a surgeon uses medical instruments during the operation, and apply that estimated shift to the simulated brain.<\/p>\n

<\/p>\n

\"\"<\/p>\n

<\/a><\/p>\n

\u201cThe power to enable surgeons to enter a virtual, 3D space, cut a piece of the skull and rehearse the operation with a simulated brain that has very similar physical properties to the patient would be tremendous,\u201d said Dr. Cohen-Gadol.<\/p>\n

To better simulate the brain\u2019s physical properties, the team adopted NVIDIA PhysX<\/a>, an advanced real-time physics simulation engine that\u2019s part of NVIDIA Omniverse. Using haptic devices, they were able to experiment with adding haptic feedback to the virtual environment, mimicking the feeling of working with brain tissue.<\/p>\n

Envisioning AI, Robotics in the Future of Surgery Training<\/b><\/h2>\n

Dr. Cohen-Gadol believes that in the coming years AI models will be able to further enhance surgery by providing additional insights during a procedure. Examples include warning surgeons about critical brain structures that are adjacent to the area they\u2019re working in, tracking medical instruments during surgery, and providing a guide to next steps in the surgery.<\/p>\n

Atlas Meditech plans to explore the NVIDIA Holoscan<\/a> platform for streaming AI applications to power these real-time, intraoperative insights. Applying AI analysis to a surgeon\u2019s actions during a procedure can provide the surgeon with useful feedback to improve their technique. <\/span><\/p>\n

In addition to being used for surgeons to rehearse operations, Dr. Cohen-Gadol says that digital twins of the brain and of the operating room could help train intelligent medical instruments such as microscope robots using Isaac Sim<\/a>, a robotics simulation application developed on Omniverse.<\/p>\n

View Dr. Cohen-Gadol\u2019s presentation at NVIDIA GTC<\/a>.<\/p>\n

Subscribe to NVIDIA healthcare news<\/i><\/a>.<\/i><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

https:\/\/blogs.nvidia.com\/blog\/2023\/10\/05\/atlas-meditech-brain-surgery-ai-digital-twins\/<\/p>\n","protected":false},"author":0,"featured_media":3204,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[],"_links":{"self":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/3203"}],"collection":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/comments?post=3203"}],"version-history":[{"count":0,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/3203\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media\/3204"}],"wp:attachment":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media?parent=3203"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/categories?post=3203"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/tags?post=3203"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}