{"id":1580,"date":"2022-02-23T16:46:53","date_gmt":"2022-02-23T16:46:53","guid":{"rendered":"https:\/\/salarydistribution.com\/machine-learning\/2022\/02\/23\/meet-the-omnivore-3d-creator-makes-fine-art-for-digital-era-inspired-by-silk-road-masterpieces\/"},"modified":"2022-02-23T16:46:53","modified_gmt":"2022-02-23T16:46:53","slug":"meet-the-omnivore-3d-creator-makes-fine-art-for-digital-era-inspired-by-silk-road-masterpieces","status":"publish","type":"post","link":"https:\/\/salarydistribution.com\/machine-learning\/2022\/02\/23\/meet-the-omnivore-3d-creator-makes-fine-art-for-digital-era-inspired-by-silk-road-masterpieces\/","title":{"rendered":"Meet the Omnivore: 3D Creator Makes Fine Art for Digital Era Inspired by Silk Road Masterpieces"},"content":{"rendered":"
\n

Editor\u2019s note: This post is a part of our <\/i>Meet the Omnivore<\/i><\/a> series, which features individual creators and developers who use <\/i>NVIDIA Omniverse<\/i><\/a> to <\/i>accelerate their 3D workflows and create virtual worlds.<\/i><\/p>\n

Within the Mogao Caves, a cultural crossroads along what was the Silk Road in northwestern China, lies a natural reserve of tens of thousands<\/a> of historical documents, paintings and statues of the Buddha.<\/p>\n

And nearly 2,000 miles away, in eastern China, 3D artist Ting Song has brought one of these statues to life \u2014 with the help of NVIDIA Omniverse<\/a>, a physically accurate 3D design collaboration platform available with RTX-powered GPUs and part of the NVIDIA Studio<\/a> suite for creators.<\/p>\n

<\/p>\n

\"\"<\/p>\n

<\/a>

Ting Song<\/figcaption><\/figure>\n

The Forbes 30 under 30 artist<\/a> explores the concept of fine art in the digital era, blending AI with traditional art, poetry and drama.<\/p>\n

Song, who divides her time between Beijing and Shanghai, created the first digital art piece that was auctioned by traditional art houses across China \u2014 a work called \u201cPeony Dream,\u201d inspired by the classic Chinese play The Peony Pavilion<\/i>.<\/p>\n

She uses Adobe After Effects and Photoshop, Blender, and Unity software with Omniverse to vivify her work.<\/p>\n

<\/p>\n

\"\"<\/p>\n

<\/a>

Song\u2019s \u2018Peony Dream\u2019 digital art piece<\/figcaption><\/figure>\n

Accelerating Art-ificial Intelligence<\/b><\/h2>\n

An avid hackathon-goer growing up, Song has shared her love of cutting-edge, open-source technology by hosting hackathons in more than a dozen countries.<\/p>\n

She saw a multitude of groundbreaking uses for technology at these events \u2014 and was particularly spurred to use AI as a tool to foster art and creativity.<\/p>\n

Her recent works of AI-based, immersive, multidimensional art focus on portraying philosophical and aesthetic themes from traditional Chinese culture.<\/p>\n

For her piece that reimagines the Buddha statue, Song used Adobe software to create its layers and NVIDIA StyleGAN2<\/a> to synthesize the colors of the murals in the Mogao Caves \u2014 before bringing it into Omniverse to \u201clet it dance,\u201d she said.<\/p>\n<\/p>\n

\u201cMy work aims to give traditional art forms new life, as many existing cultural creations don\u2019t yet exist in a 3D world, only 2D,\u201d Song said. \u201cNVIDIA Omniverse apps like Kaolin<\/a> and Audio2Face<\/a>, and NVIDIA DIB-R<\/a> models support artists who are switching from traditional creations to owning new experiences in virtual worlds.\u201d<\/p>\n

Song uses Kaolin \u2014 her favorite Omniverse app<\/a> \u2014 to inspect 3D datasets, visualize 3D outputs of a model and render synthetic datasets. Song imported models and animations from Blender and Unity into Omniverse.<\/p>\n

And with Omniverse Audio2Face, an app that quickly generates expressive facial animation from just an audio source, Song animated a virtual poet character that she plans to integrate with her \u201cPeony Dream\u201d piece.<\/p>\n

In Song\u2019s following demo, a digital human recites a Chinese poem written by AI: \u201cSpring is still lingering when swallows come \/ Strings of rain and slanting wind \/ Which trees are kissed upon \/ Stringed instruments flourish in the bloom of youth \/ The sun shines, and the lyric flows.\u201d<\/p>\n<\/p>\n

\u201cDigging into our true humanistic power by designing an artistic concept based on a play or poem \u2014 and then productizing it using the proper technological tools \u2014 is all enabled by Omniverse,\u201d Song said.<\/p>\n

In addition to revitalizing traditional works, Song often writes her own poems or scripts off of which she bases stunning visual representations made in Omniverse.<\/p>\n

The rapid iteration and collaboration capabilities of the open-source Omniverse ecosystem and the power of NVIDIA RTX technology<\/a> \u2014 which save her months\u2019 worth of model training time \u2014 provide Song with \u201cinspiration and technical confidence\u201d for her artistic endeavors, she said.<\/p>\n

\u201cI hope my work inspires people to dive deeper into their traditional cultural heritage \u2014 and encourages them to use AI as a tool to help reveal the unique creative talents they have as human beings,\u201d Song said.<\/p>\n

Learn More at GTC<\/b><\/h2>\n

Song\u2019s work will go on display in the AI Art Gallery<\/a> and AI Playground<\/a> at GTC<\/a>, which runs March 21-24. The virtual conference is free to attend<\/a> and will have dozens of sessions and special events featuring visionaries from the Omniverse team, Adobe, Autodesk, Epic Games, Pixar, Unity, Walt Disney Studios and more.<\/p>\n

Creatives will also have the opportunity to connect with one another and get a behind-the-scenes look at the Omniverse roadmap in the NVIDIA Omniverse User Group<\/a> and Developer Days<\/a>.<\/p>\n

Creators and developers can <\/i>download NVIDIA Omniverse for free<\/i><\/a> and get started with step-by-step tutorials on the <\/i>Omniverse YouTube channel<\/i><\/a>. Follow<\/i> Omniverse on <\/i>Instagram<\/i><\/a>, <\/i>Twitter<\/i><\/a> and <\/i>Medium<\/i><\/a> for additional resources and inspiration. Check out the Omniverse <\/i>forums<\/i><\/a> and join our <\/i>Discord Server<\/i><\/a> to chat with the community.<\/i><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

https:\/\/blogs.nvidia.com\/blog\/2022\/02\/23\/ting-song-omniverse-creator\/<\/p>\n","protected":false},"author":0,"featured_media":1581,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[],"_links":{"self":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/1580"}],"collection":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/comments?post=1580"}],"version-history":[{"count":0,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/1580\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media\/1581"}],"wp:attachment":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media?parent=1580"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/categories?post=1580"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/tags?post=1580"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}