{"id":2427,"date":"2022-08-01T17:38:59","date_gmt":"2022-08-01T17:38:59","guid":{"rendered":"https:\/\/salarydistribution.com\/machine-learning\/2022\/08\/01\/meet-the-omnivore-developer-builds-bots-with-nvidia-omniverse-and-isaac-sim\/"},"modified":"2022-08-01T17:38:59","modified_gmt":"2022-08-01T17:38:59","slug":"meet-the-omnivore-developer-builds-bots-with-nvidia-omniverse-and-isaac-sim","status":"publish","type":"post","link":"https:\/\/salarydistribution.com\/machine-learning\/2022\/08\/01\/meet-the-omnivore-developer-builds-bots-with-nvidia-omniverse-and-isaac-sim\/","title":{"rendered":"Meet the Omnivore: Developer Builds Bots With NVIDIA Omniverse and Isaac Sim"},"content":{"rendered":"
\n

Editor\u2019s note: This post is a part of our <\/i>Meet the Omnivore<\/i><\/a> series, which features individual creators and developers who use <\/i>NVIDIA Omniverse<\/i><\/a> to accelerate their 3D workflows and create virtual worlds.<\/i><\/p>\n

\n

\"\"

Antonio Serrano-Mu\u00f1oz<\/figcaption><\/figure>\n

While still in grad school, Antonio Serrano-Mu\u00f1oz has helped author papers spanning planetary gravities, AI-powered diagnosis of rheumatoid arthritis and robots that precisely track millimetric-sized walkers, like ants.<\/p>\n

Now, the Ph.D. student in applied robotics at Mondragon University in northern Spain, is using robotics and AI in remanufacturing to tackle issues of climate change and pollution.<\/p>\n

In short, Serrano-Mu\u00f1oz is busy discovering unique ways to apply technology to complex, real-world issues \u2014 and, in his free time, he makes extensions for NVIDIA Omniverse<\/a>, a platform for real-time 3D design collaboration and world simulation.<\/p>\n

Omniverse Extensions<\/a> are core building blocks that enable anyone to create and extend the functionality of Omniverse Apps<\/a> to meet the specific needs of their workflows with just a few lines of Python code.<\/p>\n

Serrano-Mu\u00f1oz has created six open-source Omniverse Extensions<\/a> that can be accessed on GitHub, one of which enhances the capabilities of NVIDIA Isaac Sim<\/a>, an Omniverse-powered application framework for creating photorealistic, physically accurate virtual environments in which to develop, train and simulate AI robots.<\/p>\n

\u201cSince the beginning of my Ph.D. studies, I decided to work with Isaac Sim to simulate robots,\u201d Serrano-Mu\u00f1oz said. \u201cIt offers a powerful, real-time simulation platform with an ultra-realistic physics engine and graphics \u2014 as well as a clean, simple application programming interface that makes it easy to interact with the whole system.\u201d<\/p>\n

Omniverse for Robotics Simulation<\/b><\/h2>\n

Serrano-Mu\u00f1oz has pursued robotics for as long as he can remember. Growing up in Cuba, he always fiddled with electronics, and he fell deeper in love with technology when he began coding in college.<\/p>\n

\u201cRobots can assist humans with strenuous, high-precision, repetitive and sometimes hazardous tasks,\u201d Serrano-Mu\u00f1oz said. \u201cThey have the potential to improve our lives, and I hope my work advances robotics in a way that allows us to build a better present and achieve a better future.\u201d<\/p>\n

He believes Omniverse is crucial to his doctoral studies in applied robotics.<\/p>\n

\u201cPerforming real-time, graphically realistic simulations of robotics environments wasn\u2019t possible before Omniverse,\u201d he said. \u201cThe platform opens the door to a new era of revolutionary changes in robotics, simulation and real-time collaboration.\u201d<\/p>\n

Omniverse links specialists of all kinds \u2014 engineers, designers, content creators \u2014 for the development of simulation systems, he added. Key for this is Universal Scene Description (USD)<\/a>, an open source 3D scene description and extensible file framework serving as the common language for virtual worlds.<\/p>\n

\u201cUSD plays an important role in the process of authoring, composing and reading a hierarchically organized scene to create and manipulate its rendering elements and objects,\u201d Serrano-Mu\u00f1oz said.<\/p>\n

Extending Omniverse for Isaac Sim<\/b><\/h2>\n

Using NVIDIA Omniverse, the developer has created robot simulations for industrial use cases<\/a> and a digital twin<\/a> of Mondragon University\u2019s laboratory for robotics prototyping.<\/p>\n

\n

\"\"

A digital twin of a bench in Mondragon University\u2019s robotics lab, made with NVIDIA Omniverse.<\/figcaption><\/figure>\n

And while working on such projects, Serrano-Mu\u00f1oz wanted to integrate with Isaac Sim a tool he was already familiar with: Robot Operating System, or ROS<\/a>, a set of software libraries for building robot applications. So, he created an Omniverse Extension to enable just that.<\/p>\n

The extension lets users manipulate simulated robotic systems in the Omniverse-powered Isaac Sim application via ROS control interfaces. ROS MoveIt<\/a>, a motion planning framework for robots, can be used in conjunction with Isaac Sim\u2019s dynamic control extension<\/a> and PhysX<\/a> capabilities, which bring physical accuracy to high-fidelity robotics simulations.<\/p>\n

\u201cIt\u2019s easy to develop code without leaving the Omniverse Kit,\u201d Serrano-Mu\u00f1oz said. \u201cOmniverse Extensions come with a system-wide integration API, installation, activation and reload mechanisms to augment the functionality of Omniverse Apps.\u201d<\/p>\n

This particular extension for ROS, he added, boosts agile prototyping for robotics applications \u2014 which is further accelerated by his NVIDIA RTX 3080 Laptop GPU<\/a> \u2014 making his workflow faster than ever.<\/p>\n

Hear more from Serrano-Mu\u00f1oz about using digital twins for industrial robotics by watching his NVIDIA GTC session on demand<\/a>. And watch his Community Spotlight on the Omniverse Twitch<\/a> channel happening Aug. 3 at 11 a.m. PT.<\/p>\n

Join in on the Creation<\/b><\/h2>\n

Creators and developers across the world can download NVIDIA Omniverse for free<\/a>, and enterprise teams<\/a> can use the platform for their 3D projects.<\/p>\n

Developers like Serrano-Mu\u00f1oz will join NVIDIA at SIGGRAPH<\/a>, a global computer graphics conference running Aug. 8-11. Watch the Omniverse community livestream at SIGGRAPH on Tuesday, Aug. 9, at noon PT to learn how Omniverse and other design and visualization<\/a> technologies are driving breakthroughs in graphics and GPU-accelerated software<\/a>.<\/p>\n

Plus, anyone can submit to the inaugural #ExtendOmniverse developer contest<\/a> through Friday, Aug. 19. Create an Omniverse Extension using Omniverse Code for a chance to win an NVIDIA RTX GPU.<\/p>\n

Check out artwork from other \u201cOmnivores\u201d and submit projects in the gallery<\/a>. Connect your workflows to Omniverse with software from Adobe, Autodesk, Epic Games, Maxon, Reallusion and more<\/a>.<\/p>\n

Follow NVIDIA Omniverse on <\/i>Instagram<\/i><\/a>, <\/i>Twitter<\/i><\/a>, <\/i>YouTube<\/i><\/a> and <\/i>Medium<\/i><\/a> for additional resources and inspiration. Check out the Omniverse <\/i>forums<\/i><\/a>, and join our <\/i>Discord server<\/i><\/a> and <\/i>Twitch channel<\/i><\/a> to chat with the community.<\/i><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

https:\/\/blogs.nvidia.com\/blog\/2022\/08\/01\/omniverse-developer-antonio-serrano-munoz\/<\/p>\n","protected":false},"author":0,"featured_media":2428,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[],"_links":{"self":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/2427"}],"collection":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/comments?post=2427"}],"version-history":[{"count":0,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/2427\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media\/2428"}],"wp:attachment":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media?parent=2427"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/categories?post=2427"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/tags?post=2427"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}