{"id":2979,"date":"2023-05-10T20:41:21","date_gmt":"2023-05-10T20:41:21","guid":{"rendered":"https:\/\/salarydistribution.com\/machine-learning\/2023\/05\/10\/meet-the-omnivore-creative-studio-aides-fight-against-sickle-cell-disease-with-ai-animated-short\/"},"modified":"2023-05-10T20:41:21","modified_gmt":"2023-05-10T20:41:21","slug":"meet-the-omnivore-creative-studio-aides-fight-against-sickle-cell-disease-with-ai-animated-short","status":"publish","type":"post","link":"https:\/\/salarydistribution.com\/machine-learning\/2023\/05\/10\/meet-the-omnivore-creative-studio-aides-fight-against-sickle-cell-disease-with-ai-animated-short\/","title":{"rendered":"Meet the Omnivore: Creative Studio Aides Fight Against Sickle Cell Disease With AI-Animated Short"},"content":{"rendered":"
\n

Editor\u2019s note: This post is a part of our <\/i>Meet the Omnivore<\/i><\/a> series, which features individual creators and developers who use <\/i>NVIDIA Omniverse<\/i><\/a> to accelerate their 3D workflows and create virtual worlds.<\/i><\/p>\n

Creative studio Elara Systems<\/a> doesn\u2019t shy away from sensitive subjects in its work.<\/p>\n

Part of its mission for a recent client was to use fun, captivating visuals to help normalize what could be considered a touchy health subject \u2014 and boost medical outcomes as a result.<\/p>\n

In collaboration with Boston Scientific and the Sickle Cell Society, the Elara Systems team created a character-driven 3D medical animation using the NVIDIA Omniverse<\/a> development platform for connecting 3D pipelines and building metaverse<\/a> applications.<\/p>\n

The video aims to help adolescents experiencing sickle cell disease understand the importance of quickly telling an adult or a medical professional if they\u2019re experiencing symptoms like priapism \u2014 a prolonged, painful erection that could lead to permanent bodily damage.<\/p>\n

\u201cNeedless to say, this is something that could be quite frightening for a young person to deal with,\u201d said Benjamin Samar, technical director at Elara Systems. \u201cWe wanted to make it crystal clear that living with and managing this condition is achievable and, most importantly, that there\u2019s nothing to be ashamed of.\u201d<\/p>\n<\/p>\n

To bring their projects to life, the Elara Systems team turns to the USD Composer<\/a> app, generative AI<\/a>-powered Audio2Face<\/a> and Audio2Gesture<\/a>, as well as Omniverse Connectors<\/a> to Adobe Substance 3D Painter, Autodesk 3ds Max, Autodesk Maya and other popular 3D content-creation tools like Blender, Epic Games Unreal Engine, Reallusion iClone and Unity.<\/p>\n

For the sickle cell project, the team relied on Adobe Substance 3D Painter to organize various 3D environments and apply custom textures to all five characters. Adobe After Effects was used to composite the rendered content into a single, cohesive short film.<\/p>\n

It\u2019s all made possible thanks to the open and extensible Universal Scene Description (USD)<\/a> framework on which Omniverse is built.<\/p>\n

\u201cUSD is extremely powerful and solves a ton of problems that many people may not realize even exist when it comes to effectively collaborating on a project,\u201d Samar said. \u201cFor example, I can build a scene in Substance 3D Painter, export it to USD format and bring it into USD Composer with a single click. Shaders are automatically generated and linked, and we can customize things further if desired.\u201d<\/p>\n

An Animation to Boost Awareness<\/b><\/h2>\n

Grounding the sickle cell awareness campaign in a relatable, personal narrative was a \u201cuniquely human approach to an otherwise clinical discussion,\u201d said Samar, who has nearly two decades of industry experience spanning video production, motion graphics, 3D animation and extended reality.<\/p>\n

The team accomplished this strategy through a 3D character named Leon \u2014 a 13-year-old soccer lover who shares his experiences about a tough day when he first learned how to manage his sickle cell disease.<\/p>\n

\"\"
3D character Leon in the Omniverse viewport.<\/figcaption><\/figure>\n

The project began with detailed discussions about Sickle Cell Society\u2019s goals for the short, followed by scripting, storyboarding and creating various sketches. \u201cOnce an early concept begins to crystallize in the artists\u2019 minds, the creative process is born and begins to build momentum,\u201d Samar said.<\/p>\n

\"\"
Sketches for Leon\u2019s story.<\/figcaption><\/figure>\n

Then, the team created rough 2D mockups using the illustration app Procreate on a tablet. This stage of the artistic process centered on establishing character outfits, proportions and other details. The final concept art was used as a clear reference to drive the rest of the team\u2019s design decisions.<\/p>\n

\"\"
Rough animations of Leon made with Procreate.<\/figcaption><\/figure>\n

Moving to 3D, the Elara Systems team tapped Autodesk Maya to build, rig and fully animate the characters, as well as Adobe Substance 3D Painter and Autodesk 3ds Max to create the short\u2019s various environments.<\/p>\n

\u201cI\u2019ve found the animated point cache export option in the Omniverse Connector for Maya to be invaluable,\u201d Samar said. \u201cIt helps ensure that what we\u2019re seeing in Maya will persist when brought into USD Composer, which is where we take advantage of real-time rendering to create high-quality visuals.\u201d<\/p>\n

The real-time rendering enabled by Omniverse was \u201ccritically important, because without it, we would have had zero chance of completing and delivering this content anywhere near our targeted deadline,\u201d the technical artist said.<\/p>\n

\"\"
Leon brought to life in 3D using Adobe Substance 3D Painter, Autodesk Maya and USD Composer.<\/figcaption><\/figure>\n

\u201cI\u2019m also a big fan of the Reallusion to Omniverse workflow,\u201d he added.<\/p>\n

The Connector allows users to easily bring characters created using Reallusion iClone into Omniverse, which helps to deliver visually realistic skin shaders. And USD Composer can enable real-time performance sessions for iClone characters when live-linked with a motion-capture system.<\/p>\n

\u201cOmniverse offers so much potential to help streamline workflows for traditional 3D animation teams, and this is just scratching the surface \u2014 there\u2019s an ever-expanding feature set for those interested in robotics, digital twins, extended reality and game design,\u201d Samar said. \u201cWhat I find most assuring is the sheer speed of the platform\u2019s development \u2014 constant updates and new features are being added at a rapid pace.\u201d<\/p>\n

Join In on the Creation<\/b><\/h2>\n

Creators<\/a> and developers<\/a> across the world can download NVIDIA Omniverse for free<\/a>, and enterprise teams<\/a> can use the platform for their 3D projects.<\/p>\n

Check out artwork from other \u201cOmnivores\u201d and submit projects in the gallery<\/a>. Connect your workflows to Omniverse with software from Adobe, Autodesk, Epic Games, Maxon, Reallusion and more<\/a>.<\/p>\n

Follow NVIDIA Omniverse on <\/i>Instagram<\/i><\/a>, <\/i>Medium<\/i><\/a>, <\/i>Twitter<\/i><\/a> and <\/i>YouTube<\/i><\/a> for additional resources and inspiration. Check out the Omniverse <\/i>forums<\/i><\/a>, and join our <\/i>Discord server<\/i><\/a> and <\/i>Twitch <\/i><\/a>channel<\/i> to chat with the community.<\/i><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

https:\/\/blogs.nvidia.com\/blog\/2023\/05\/10\/elara-systems-omniverse-creator\/<\/p>\n","protected":false},"author":0,"featured_media":2980,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[],"_links":{"self":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/2979"}],"collection":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/comments?post=2979"}],"version-history":[{"count":0,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/2979\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media\/2980"}],"wp:attachment":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media?parent=2979"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/categories?post=2979"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/tags?post=2979"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}