{"id":3723,"date":"2024-09-04T13:47:53","date_gmt":"2024-09-04T13:47:53","guid":{"rendered":"https:\/\/salarydistribution.com\/machine-learning\/2024\/09\/04\/do-the-math-new-rtx-ai-pc-hardware-delivers-more-ai-faster\/"},"modified":"2024-09-04T13:47:53","modified_gmt":"2024-09-04T13:47:53","slug":"do-the-math-new-rtx-ai-pc-hardware-delivers-more-ai-faster","status":"publish","type":"post","link":"https:\/\/salarydistribution.com\/machine-learning\/2024\/09\/04\/do-the-math-new-rtx-ai-pc-hardware-delivers-more-ai-faster\/","title":{"rendered":"Do the Math: New RTX AI PC Hardware Delivers More AI, Faster"},"content":{"rendered":"
\n\t\t<\/span> <\/span> <\/span><\/span><\/p>\n

Editor\u2019s note: This post is part of the <\/i>AI Decoded series<\/i><\/a>, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.<\/i><\/p>\n

At the IFA Berlin<\/a> consumer electronics and home appliances trade show this week, new RTX AI PCs will be announced, powered by RTX GPUs for advanced AI in gaming, content creation, development and academics and a neural processing unit (NPU) for offloading lightweight AI.<\/p>\n

RTX GPUs, built with specialized AI hardware called Tensor Cores<\/a>, provide the compute performance needed to run the latest and most demanding AI models. They now accelerate more than 600 AI-enabled games and applications, with more than 100 million GeForce RTX<\/a> and NVIDIA RTX<\/a> GPUs in users\u2019 hands worldwide.<\/p>\n

\"\"<\/a><\/p>\n

Since the launch of NVIDIA DLSS<\/a> \u2014 the first widely deployed PC AI technology \u2014 more than five years ago, on-device AI has expanded beyond gaming to livestreaming, content creation, software development, productivity and STEM use cases.<\/p>\n

Accelerating AI\u00a0<\/b><\/h2>\n

AI boils down to massive matrix multiplication \u2014 in other words, incredibly complex math. CPUs can do math, but, as serial processors, they can only perform one operation per CPU core at a time. This makes them far too slow for practical use with AI.<\/p>\n

GPUs, on the other hand, are parallel processors, performing multiple operations at once. With hundreds of Tensor Cores each and being optimized for AI, RTX GPUs can accelerate incredibly complex mathematical operations.<\/p>\n

RTX-powered systems give users a powerful GPU accelerator for demanding AI workloads in gaming, content creation, software development and STEM subjects. Some also include an NPU, a lightweight accelerator for offloading select low-power workloads.<\/p>\n

Local accelerators make AI capabilities always available (even without an internet connection), offer low latency for high responsiveness and increase privacy so that users don\u2019t have to upload sensitive materials to an online database before they become usable by an AI model.<\/p>\n

Advanced Processing Power<\/b><\/h2>\n

NVIDIA powers much of the world\u2019s AI \u2014 from data center to the edge to an install base of over 100 million PCs worldwide.<\/p>\n

The GeForce RTX and NVIDIA RTX GPUs found in laptops, desktops and workstations share the same architecture as cloud servers and provide up to 686 AI trillion operations operations per second (TOPS) across the GeForce RTX 40 Series Laptop GPU<\/a> lineup.<\/p>\n

\"\"<\/a>RTX GPUs unlock top-tier performance and power a wider range of AI and generative AI than systems with just an integrated system-on-a-chip (SoC).<\/p>\n

\n

\u201cMany projects, especially within Windows, are built for and expect to run on NVIDIA cards. In addition to the wide software support base, NVIDIA GPUs also have an advantage in terms of raw performance.\u201d \u2014 Jon Allman, industry analyst at Puget Systems<\/a><\/p>\n<\/blockquote>\n

Gamers can use DLSS for AI-enhanced performance and can look forward to NVIDIA ACE digital human technology<\/a> for next-generation in-game experiences. Creators can use AI-accelerated video and photo editing tools, asset generators, AI denoisers and more. Everyday users can tap RTX Video Super Resolution<\/a> and RTX Video HDR<\/a> for improved video quality, and NVIDIA ChatRTX<\/a> and NVIDIA Broadcast<\/a> for productivity improvements. And developers can use RTX-powered coding and debugging tools, as well as the NVIDIA RTX AI Toolkit<\/a> to build and deploy AI-enabled apps for RTX.<\/p>\n

Large language models \u2014 like Google\u2019s Gemma, Meta\u2019s Llama and Microsoft\u2019s Phi \u2014 all run faster on RTX AI PCs, as systems with GPUs load LLMs into VRAM. Add in NVIDIA TensorRT-LLM<\/a> acceleration and RTX GPUs can run LLMs 10-100x faster than on CPUs<\/a>.<\/p>\n

New RTX AI PCs Available Now<\/b><\/h2>\n

New systems from ASUS and MSI are now shipping with up to GeForce RTX 4070 Laptop GPUs \u2014 delivering up to 321 AI TOPS of performance \u2014 and power-efficient SoCs with Windows 11 AI PC capabilities. Windows 11 AI PCs will receive a free update to Copilot+ PC experiences when available.<\/p>\n

\"\"<\/a><\/p>\n

ASUS\u2019 Zephyrus G16<\/a> comes with up to a GeForce RTX 4070 Laptop GPU to supercharge photo and video editing, image generation and coding, while game-enhancing features like DLSS create additional high-quality frames and improve image quality. The 321 TOPS of local AI processing power available from the GeForce RTX 4070 Laptop GPU enables multiple AI applications to run simultaneously, changing the way gamers, creators and engineers work and play.<\/p>\n

\"\"<\/a><\/p>\n

The ASUS ProArt P16 is the first AI PC built for advanced AI workflows across creativity, gaming, productivity and more. Its GeForce RTX 4070 Laptop GPU provides creatives with RTX AI acceleration in top 2D, 3D, video editing and streaming apps. The ASUS ProArt P13 also comes with state-of-the-art graphics and an OLED touchscreen for ease of creation. Both laptops also come NVIDIA Studio-validated, enabling and accelerating your creativity.<\/p>\n

\"\"<\/a><\/p>\n

The MSI Stealth A16 AI+<\/a> features the latest GeForce RTX 40 Series Laptop GPUs, delivering up to 321 AI TOPS with a GeForce RTX 4070 Laptop GPU. This fast and intelligent AI-powered PC is designed to excel in gaming, creation and productivity, offering access to next-level technology.<\/p>\n

These laptops join hundreds of RTX AI PCs available today from top manufacturers, with support for the 600+ AI applications and games accelerated by RTX.<\/p>\n

Generative AI is transforming graphics and interactive experiences of all kinds. Make sense of what\u2019s new and what\u2019s next by subscribing to the\u00a0<\/i>AI Decoded newsletter<\/i><\/a>.<\/i><\/p>\n

\t\t<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"

https:\/\/blogs.nvidia.com\/blog\/rtx-ai-pc-hardware\/<\/p>\n","protected":false},"author":0,"featured_media":3724,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[],"_links":{"self":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/3723"}],"collection":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/comments?post=3723"}],"version-history":[{"count":0,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/3723\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media\/3724"}],"wp:attachment":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media?parent=3723"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/categories?post=3723"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/tags?post=3723"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}