{"id":3451,"date":"2024-05-13T06:40:50","date_gmt":"2024-05-13T06:40:50","guid":{"rendered":"https:\/\/salarydistribution.com\/machine-learning\/2024\/05\/13\/generating-science-nvidia-ai-accelerates-hpc-research\/"},"modified":"2024-05-13T06:40:50","modified_gmt":"2024-05-13T06:40:50","slug":"generating-science-nvidia-ai-accelerates-hpc-research","status":"publish","type":"post","link":"https:\/\/salarydistribution.com\/machine-learning\/2024\/05\/13\/generating-science-nvidia-ai-accelerates-hpc-research\/","title":{"rendered":"Generating Science: NVIDIA AI Accelerates HPC Research"},"content":{"rendered":"<div>\n\t\t<span class=\"bsf-rt-reading-time\"><span class=\"bsf-rt-display-label\"><\/span> <span class=\"bsf-rt-display-time\"><\/span> <span class=\"bsf-rt-display-postfix\"><\/span><\/span><\/p>\n<p>Generative AI is taking root at national and corporate labs, accelerating high-performance computing for business and science.<\/p>\n<p>Researchers at Sandia National Laboratories aim to automatically <a href=\"https:\/\/developer.nvidia.com\/blog\/advanced-ai-and-retrieval-augmented-generation-for-code-development-in-high-performance-computing\/\">generate code in Kokkos<\/a>, a parallel programming language designed for use across many of the world\u2019s largest supercomputers.<\/p>\n<p>It\u2019s an ambitious effort. The specialized language, developed by researchers from several national labs, handles the nuances of running tasks across tens of thousands of processors.<\/p>\n<p>Sandia is employing retrieval-augmented generation (<a href=\"https:\/\/blogs.nvidia.com\/blog\/what-is-retrieval-augmented-generation\/\">RAG<\/a>) to create and link a Kokkos database with AI models. As researchers experiment with different RAG approaches, initial tests show promising results.<\/p>\n<p>Cloud-based services like <a href=\"https:\/\/developer.nvidia.com\/blog\/translate-your-enterprise-data-into-actionable-insights-with-nvidia-nemo-retriever\/\">NeMo Retriever<\/a> are among the RAG options the scientists will evaluate.<\/p>\n<p>\u201cNVIDIA provides a rich set of tools to help us significantly accelerate the work of our HPC software developers,\u201d said Robert Hoekstra, a senior manager of extreme scale computing at Sandia.<\/p>\n<p>Building copilots via model tuning and RAG is just a start. Researchers eventually aim to employ foundation models trained with scientific data from fields such as climate, biology and material science.<\/p>\n<h2><b>Getting Ahead of the Storm<\/b><\/h2>\n<p>Researchers and companies in weather forecasting are embracing <a href=\"https:\/\/arxiv.org\/abs\/2309.15214\">CorrDiff<\/a>, a generative AI model that\u2019s part of <a href=\"https:\/\/www.nvidia.com\/en-us\/high-performance-computing\/earth-2\/\">NVIDIA Earth-2<\/a>, a set of services and software for weather and climate research.<\/p>\n<p>CorrDiff can scale the 25km resolution of traditional atmosphere models down to 2 kilometers and expand by more than 100x the number of forecasts that can be combined to improve confidence in predictions.<\/p>\n<p>\u201cIt\u2019s a promising innovation \u2026 We plan to leverage such models in our global and regional AI forecasts for richer insights,\u201d said Tom Gowan, machine learning and modeling lead for Spire, a company in Vienna, Va., that collects data from its own network of tiny satellites.<\/p>\n<p>Generative AI enables faster, more accurate forecasts, he said in a recent <a href=\"https:\/\/spire.com\/blog\/weather-climate\/ai-weather-modeling-spire-and-nvidia-partnership\/\">interview<\/a>.<\/p>\n<p>\u201cIt really feels like a big jump in meteorology,\u201d he added. \u201cAnd by partnering with NVIDIA, we have access to the world\u2019s best GPUs that are the most reliable, fastest and most efficient ones for both training and inference.\u201d<\/p>\n<p><a href=\"https:\/\/blogs.nvidia.com\/wp-content\/uploads\/2024\/05\/Spire-weather-forecast.jpg\"><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter size-large wp-image-71561\" src=\"https:\/\/blogs.nvidia.com\/wp-content\/uploads\/2024\/05\/Spire-weather-forecast-672x410.jpg\" alt=\"Graphic showing Spire weather forecast\" width=\"672\" height=\"410\"><\/a><\/p>\n<p>Switzerland-based Meteomatics recently <a href=\"https:\/\/www.meteomatics.com\/en\/news\/meteomatics-nvidia-ai-based-weather-forecasts\/\">announced<\/a> it also plans to use NVIDIA\u2019s generative AI platform for its weather forecasting business.<\/p>\n<p>\u201cOur work with NVIDIA will help energy companies maximize their renewable energy operations and increase their profitability with quick and accurate insight into weather fluctuations,\u201d said Martin Fengler, founder and CEO of Meteomatics.<\/p>\n<h2><b>Generating Genes to Improve Healthcare<\/b><\/h2>\n<p>At Argonne National Laboratory, scientists are using the technology to generate gene sequences that help them better understand the virus behind COVID-19. Their award-winning models, called GenSLMs, spawned simulations that closely resemble real-world variants of SARS-CoV-2.<\/p>\n<p>\u201cUnderstanding how different parts of the genome are co-evolving gives us clues about how the virus may develop new vulnerabilities or new forms of resistance,\u201d Arvind Ramanathan, a lead researcher, said in <a href=\"https:\/\/blogs.nvidia.com\/blog\/generative-ai-covid-genome-sequences\/\">a blog<\/a>.<\/p>\n<p>GenSLMs were trained on more than 110 million genome sequences with <a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/tensor-cores\/\">NVIDIA A100 Tensor Core GPU<\/a>-powered supercomputers, including Argonne\u2019s <a href=\"https:\/\/nvidianews.nvidia.com\/news\/nvidia-turbocharges-extreme-scale-ai-for-argonne-national-laboratorys-polaris-supercomputer\">Polaris<\/a> system, the U.S. Department of Energy\u2019s <a href=\"https:\/\/blogs.nvidia.com\/blog\/nersc-perlmutter-ai-supercomputer\/\">Perlmutter<\/a> and NVIDIA\u2019s <a href=\"https:\/\/blogs.nvidia.com\/blog\/making-selene-pandemic-ai\/\">Selene<\/a>.<\/p>\n<h2><b>Microsoft Proposes Novel Materials<\/b><\/h2>\n<p>Microsoft Research showed how generative AI can accelerate work in materials science.<\/p>\n<p>Their <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/mattergen-property-guided-materials-design\/\">MatterGen<\/a> model generates novel, stable materials that exhibit desired properties. The approach enables specifying chemical, magnetic, electronic, mechanical and other desired properties.<\/p>\n<p>\u201cWe believe MatterGen is an important step forward in AI for materials design,\u201d the Microsoft Research team wrote of the model they trained on Azure AI infrastructure with NVIDIA A100 GPUs.<\/p>\n<p>Companies such as <a href=\"https:\/\/developer.nvidia.com\/blog\/using-graph-neural-networks-for-additive-manufacturing\/\">Carbon3D<\/a> are already finding opportunities, applying generative AI to materials science in commercial 3D printing operations.<\/p>\n<p>It\u2019s just the beginning of what researchers will be able to do for HPC and science with generative AI. The <a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/h200\/\">NVIDIA H200 Tensor Core GPUs<\/a> available now and the upcoming <a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/technologies\/blackwell-architecture\/\">NVIDIA Blackwell Architecture GPUs<\/a> will take their work to new levels.<\/p>\n<p>Learn more about tools like <a href=\"https:\/\/developer.nvidia.com\/modulus\">NVIDIA Modulus<\/a>, a key component in the Earth-2 platform for building AI models that obey the laws of physics, and <a href=\"https:\/\/docs.nvidia.com\/megatron-core\/index.html\">NVIDIA Megatron-Core<\/a>, a NeMo library to tune and train large language models.<\/p>\n<p>\t\t<!-- .entry-footer --><\/p><\/div>\n","protected":false},"excerpt":{"rendered":"<p>https:\/\/blogs.nvidia.com\/blog\/generative-ai-science-isc\/<\/p>\n","protected":false},"author":0,"featured_media":3452,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[],"_links":{"self":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/3451"}],"collection":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/comments?post=3451"}],"version-history":[{"count":0,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/3451\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media\/3452"}],"wp:attachment":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media?parent=3451"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/categories?post=3451"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/tags?post=3451"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}