{"id":3007,"date":"2023-05-29T06:06:31","date_gmt":"2023-05-29T06:06:31","guid":{"rendered":"https:\/\/salarydistribution.com\/machine-learning\/2023\/05\/29\/live-from-taipei-nvidia-ceo-unveils-gen-ai-platforms-for-every-industry\/"},"modified":"2023-05-29T06:06:31","modified_gmt":"2023-05-29T06:06:31","slug":"live-from-taipei-nvidia-ceo-unveils-gen-ai-platforms-for-every-industry","status":"publish","type":"post","link":"https:\/\/salarydistribution.com\/machine-learning\/2023\/05\/29\/live-from-taipei-nvidia-ceo-unveils-gen-ai-platforms-for-every-industry\/","title":{"rendered":"Live From Taipei: NVIDIA CEO Unveils Gen AI Platforms for Every Industry"},"content":{"rendered":"
\n

In his first live keynote since the pandemic, NVIDIA founder and CEO Jensen Huang today kicked off the COMPUTEX conference in Taipei, announcing platforms that companies can use to ride a historic wave of generative AI that\u2019s transforming industries from advertising to manufacturing to telecom.<\/p>\n

\u201cWe\u2019re back,\u201d Huang roared as he took the stage after years of virtual keynotes, some from his home kitchen. \u201cI haven\u2019t given a public speech in almost four years \u2014 wish me luck!\u201d<\/p>\n

Speaking for nearly two hours to a packed house of some 3,500, he described accelerated computing<\/a> services, software and systems that are enabling new business models and making current ones more efficient.<\/p>\n

\u201cAccelerated computing and AI mark a reinvention of computing,\u201d said Huang, whose travels in his hometown over the past week have been tracked daily by local media.<\/p>\n

In a demonstration of its power, he used the massive 8K wall he spoke in front of to show a text prompt generating a theme song for his keynote, singable as any karaoke tune. Huang, who occasionally bantered with the crowd in his native Taiwanese, briefly led the audience in singing the new anthem.<\/p>\n

\u201cWe\u2019re now at the tipping point of a new computing era with accelerated computing and AI that\u2019s been embraced by almost every computing and cloud company in the world,\u201d he said, noting 40,000 large companies and 15,000 startups now use NVIDIA technologies with 25 million downloads of CUDA software last year alone.<\/p>\n

Top News Announcements From the Keynote<\/b><\/h2>\n

A New Engine for Enterprise AI<\/b><\/h2>\n

For enterprises that need the ultimate in AI performance, he unveiled DGX GH200<\/a>, a large-memory AI supercomputer. It uses NVIDIA NVLink<\/a> to combine up to 256 NVIDIA GH200 Grace Hopper Superchips<\/a> into a single data-center-sized GPU.<\/p>\n

The GH200 Superchip, which Jensen said is now in full production<\/a>, combines an energy-efficient NVIDIA Grace CPU<\/a> with a high-performance NVIDIA H100 Tensor Core GPU<\/a> in one superchip.<\/p>\n

The DGX GH200 packs an exaflop of performance and 144 terabytes of shared memory, nearly 500x more than in a single NVIDIA DGX A100 320GB system. That lets developers build large language models<\/a> for generative AI chatbots, complex algorithms for recommender systems<\/a>, and graph neural networks<\/a> used for fraud detection and data analytics.<\/p>\n

Google Cloud, Meta and Microsoft are among the first expected to gain access to the DGX GH200, which can be used as a blueprint for future hyperscale generative AI infrastructure.<\/p>\n

\"NVIDIA<\/a>
NVIDIA\u2019s DGX GH200 AI supercomputer delivers 1 exaflop of performance for generative AI.<\/figcaption><\/figure>\n

\u201cDGX GH200 AI supercomputers integrate NVIDIA\u2019s most advanced accelerated computing and networking technologies to expand the frontier of AI,\u201d Huang told the audience in Taipei, many of whom had lined up outside the hall for hours before the doors opened.<\/p>\n

NVIDIA is building its own massive AI supercomputer, NVIDIA Helios, coming online this year. It will use four DGX GH200 systems linked with NVIDIA Quantum-2 InfiniBand<\/a> networking to supercharge data throughput for training large AI models.<\/p>\n

The DGX GH200 forms the pinnacle of hundreds of systems announced at the event. Together, they\u2019re bringing generative AI and accelerated computing to millions of users.<\/p>\n

Zooming out to the big picture, Huang announced more than 400 system configurations<\/a> are coming to market powered by NVIDIA\u2019s latest Hopper<\/a>, Grace, Ada Lovelace<\/a> and BlueField<\/a> architectures. They aim to tackle the most complex challenges in AI, data science and high performance computing.<\/p>\n

Acceleration in Every Size<\/b><\/h2>\n

To fit the needs of data centers of every size, Huang announced NVIDIA MGX<\/a>, a modular reference architecture for creating accelerated servers. System makers will use it to quickly and cost-effectively build more than a hundred different server configurations to suit a wide range of AI, HPC and NVIDIA Omniverse<\/a> applications.<\/p>\n

MGX lets manufacturers build CPU and accelerated servers using a common architecture and modular components. It supports NVIDIA\u2019s full line of GPUs, CPUs, data processing units (DPUs<\/a>) and network adapters as well as x86 and Arm processors across a variety of air- and liquid-cooled chassis.<\/p>\n

QCT and Supermicro will be the first to market with MGX designs appearing in August. Supermicro\u2019s ARS-221GL-NR system announced at COMPUTEX will use the Grace CPU, while QCT\u2019s S74G-2U system, also announced at the event, uses Grace Hopper.<\/p>\n

ASRock Rack, ASUS, GIGABYTE and Pegatron will also use MGX to create next-generation accelerated computers.<\/p>\n

5G\/6G Calls for Grace Hopper<\/b><\/h2>\n

Separately, Huang said NVIDIA is helping shape future 5G and 6G wireless and video communications. A demo showed how AI running on Grace Hopper will transform today\u2019s 2D video calls into more lifelike 3D experiences, providing an amazing sense of presence.<\/p>\n

Laying the groundwork for new kinds of services, Huang announced NVIDIA is working with telecom giant SoftBank to build a distributed network of data centers in Japan. It will deliver 5G services and generative AI applications on a common cloud platform.<\/p>\n

The data centers will use NVIDIA GH200 Superchips and NVIDIA BlueField-3 DPUs<\/a> in modular MGX systems as well as NVIDIA Spectrum Ethernet switches<\/a> to deliver the highly precise timing the 5G protocol requires. The platform will reduce cost by increasing spectral efficiency while reducing energy consumption.<\/p>\n

The systems will help SoftBank explore 5G applications in autonomous driving, AI factories, augmented and virtual reality, computer vision and digital twins. Future uses could even include 3D video conferencing and holographic communications.<\/p>\n

Turbocharging Cloud Networks<\/b><\/h2>\n

Separately, Huang unveiled NVIDIA Spectrum-X<\/a>, a networking platform purpose-built to improve the performance and efficiency of Ethernet-based AI clouds. It combines Spectrum-4 Ethernet switches with BlueField-3 DPUs and software to deliver 1.7x gains in AI performance and power efficiency over traditional Ethernet fabrics.<\/p>\n

NVIDIA Spectrum-X<\/a>, Spectrum-4 switches and BlueField-3 DPUs are available now from system makers including Dell Technologies, Lenovo and Supermicro.<\/p>\n

\"NVIDIA<\/a>
NVIDIA Spectrum-X accelerates AI workflows that can experience performance losses on traditional Ethernet networks.<\/figcaption><\/figure>\n

Bringing Game Characters to Life<\/b><\/h2>\n

Generative AI impacts how people play, too.<\/p>\n

Huang announced NVIDIA Avatar Cloud Engine (ACE) for Games<\/a>, a foundry service developers can use to build and deploy custom AI models for speech, conversation and animation. It will give non-playable characters conversational skills so they can respond to questions with lifelike personalities that evolve.<\/p>\n

NVIDIA ACE for Games includes AI foundation models<\/a> such as NVIDIA Riva<\/a> to detect and transcribe the player\u2019s speech. The text prompts NVIDIA NeMo<\/a> to generate customized responses animated with NVIDIA Omniverse Audio2Face<\/a>.<\/p>\n

\"NVIDIA<\/a>
NVIDIA ACE for Games provides a tool chain for bringing characters to life with generative AI.<\/figcaption><\/figure>\n

Accelerating Gen AI on Windows<\/b><\/h2>\n

Huang described how NVIDIA and Microsoft are collaborating to drive innovation<\/a> for Windows PCs in the generative AI era.<\/p>\n

New and enhanced tools, frameworks and drivers are making it easier for PC developers to develop and deploy AI. For example, the Microsoft Olive toolchain for optimizing and deploying GPU-accelerated AI models and new graphics drivers will boost DirectML performance on Windows PCs with NVIDIA GPUs.<\/p>\n

The collaboration will enhance and extend an installed base of 100 million PCs sporting RTX GPUs with Tensor Cores that boost performance of more than 400 AI-accelerated Windows apps and games.<\/p>\n

Digitizing the World\u2019s Largest Industries<\/b><\/h2>\n

Generative AI is also spawning new opportunities in the $700 billion digital advertising industry.<\/p>\n

For example, WPP, the world\u2019s largest marketing services organization, is working with NVIDIA to build a first-of-its kind generative AI-enabled content engine on Omniverse Cloud<\/a>.<\/p>\n

In a demo, Huang showed how creative teams will connect their 3D design tools such as Adobe Substance 3D, to build digital twins of client products in NVIDIA Omniverse. Then, content from generative AI tools trained on responsibly sourced data and built with NVIDIA Picasso<\/a> will let them quickly produce virtual sets. WPP clients can then use the complete scene to generate a host of ads, videos and 3D experiences for global markets and users to experience on any web device.<\/p>\n

\u201cToday ads are retrieved, but in the future when you engage information much of it will be generated \u2014 the computing model has changed,\u201d Huang said.<\/p>\n

Factories Forge an AI Future<\/b><\/h2>\n

With an estimated 10 million factories, the $46 trillion manufacturing sector is a rich field for industrial digitalization.<\/p>\n

\u201cThe world\u2019s largest industries make physical things. Building them digitally first can save billions,\u201d said Huang.<\/p>\n

The keynote showed how electronics makers including Foxconn Industrial Internet, Innodisk, Pegatron, Quanta and Wistron are forging digital workflows with NVIDIA technologies to realize the vision of an entirely digital smart factory.<\/p>\n

They\u2019re using Omniverse and generative AI APIs to connect their design and manufacturing tools so they can build digital twins of factories. In addition, they use NVIDIA Isaac Sim<\/a> for simulating and testing robots and NVIDIA Metropolis<\/a>, a vision AI framework, for automated optical inspection.<\/p>\n

The latest component, NVIDIA Metropolis for Factories<\/a>, can create custom quality-control systems, giving manufacturers a competitive advantage. It\u2019s helping companies develop state-of-the-art AI applications.<\/p>\n

AI Speeds Assembly Lines<\/b><\/h2>\n

For example, Pegatron \u2014 which makes 300 products worldwide, including laptops and smartphones \u2014 is creating virtual factories with Omniverse, Isaac Sim and Metropolis. That lets it try out processes in a simulated environment, saving time and cost.<\/p>\n

Pegatron also used the NVIDIA DeepStream software development kit<\/a> to develop intelligent video applications that led to a 10x improvement in throughput.<\/p>\n

Foxconn Industrial Internet, a service arm of the world\u2019s largest technology manufacturer, is working with NVIDIA Metropolis partners to automate significant portions of its circuit-board quality-assurance inspection points.<\/p>\n

\"Computex<\/a>
Crowds lined up for the keynote hours before doors opened.<\/figcaption><\/figure>\n

In a video, Huang showed how Techman Robot, a subsidiary of Quanta, tapped NVIDIA Isaac Sim to optimize inspection on the Taiwan-based giant\u2019s manufacturing lines. It\u2019s essentially using simulated robots to train robots how to make better robots.<\/p>\n

In addition, Huang announced<\/a> a new platform to enable the next generation of autonomous mobile robot (AMR) fleets. Isaac AMR<\/a> helps simulate, deploy and manage fleets of autonomous mobile robots.<\/p>\n

A large partner ecosystem \u2014 including ADLINK, Aetina, Deloitte, Quantiphi and Siemens \u2014 is helping bring all these manufacturing solutions to market, Huang said.<\/p>\n

It\u2019s one more example of how NVIDIA is helping companies feel the benefits of generative AI with accelerated computing.<\/p>\n

\u201cIt\u2019s been a long time since I\u2019ve seen you, so I had a lot to tell you,\u201d he said after the two-hour talk to enthusiastic applause.<\/p>\n

To learn more, watch the full keynote<\/a>.<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

https:\/\/blogs.nvidia.com\/blog\/2023\/05\/28\/computex-keynote-generative-ai\/<\/p>\n","protected":false},"author":0,"featured_media":3008,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[],"_links":{"self":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/3007"}],"collection":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/comments?post=3007"}],"version-history":[{"count":0,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/3007\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media\/3008"}],"wp:attachment":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media?parent=3007"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/categories?post=3007"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/tags?post=3007"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}