{"id":3229,"date":"2023-10-23T20:54:50","date_gmt":"2023-10-23T20:54:50","guid":{"rendered":"https:\/\/salarydistribution.com\/machine-learning\/2023\/10\/23\/street-view-to-the-rescue-deep-learning-paves-the-way-to-safer-buildings\/"},"modified":"2023-10-23T20:54:50","modified_gmt":"2023-10-23T20:54:50","slug":"street-view-to-the-rescue-deep-learning-paves-the-way-to-safer-buildings","status":"publish","type":"post","link":"https:\/\/salarydistribution.com\/machine-learning\/2023\/10\/23\/street-view-to-the-rescue-deep-learning-paves-the-way-to-safer-buildings\/","title":{"rendered":"Street View to the Rescue: Deep Learning Paves the Way to Safer Buildings"},"content":{"rendered":"<div id=\"bsf_rt_marker\">\n<p>Images such as those in Google Street View are taking on a new purpose in the hands of University of Florida Assistant Professor of Artificial Intelligence Chaofeng Wang.<\/p>\n<p>He\u2019s using them, along with deep learning, in a research project to automate the evaluation of urban buildings. The project aims to help governments mitigate natural disaster damage by providing the information needed for decision-makers to bolster building structures or perform post-disaster recovery.<\/p>\n<p>After a natural disaster such as an earthquake, local governments send teams to check and evaluate building conditions. Manually done, it can take up to months to go through the full stock of a city.<\/p>\n<p>Wang\u2019s project uses AI to accelerate the evaluation process \u2014 cutting the time needed to a few hours. The AI model is trained using images sourced from Google Street View and local governments to assign scores to buildings based on <a href=\"https:\/\/www.fema.gov\/emergency-managers\/risk-management\/earthquake\/training\/fema-p-154\" target=\"_blank\" rel=\"noopener\">Federal Emergency Management Agency (FEMA) P-154 standards<\/a>, which provide assessment guidelines based on factors like wall material, structure type, building age and more. Wang also collaborated with the <a href=\"https:\/\/www.worldbank.org\/en\/topic\/disasterriskmanagement\/brief\/global-program-for-resilient-housing\" target=\"_blank\" rel=\"noopener\">World Bank Global Program for Resilient Housing<\/a> to collect images and perform annotations, which were used to improve the model.<\/p>\n<p>The collected images are placed in a data repository. The AI model reads the repository and performs inference on the images \u2014 a process accelerated by <a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/dgx-a100\/\" target=\"_blank\" rel=\"noopener\">NVIDIA DGX A100<\/a> systems.<\/p>\n<p>\u201cWithout NVIDIA GPUs, we wouldn\u2019t have been able to do this,\u201d Wang said. \u201cThey significantly accelerate the process, ensuring timely results.\u201d<\/p>\n<p>Wang used the DGX A100 nodes in the <a href=\"https:\/\/blogs.nvidia.com\/blog\/2020\/07\/21\/university-of-florida-nvidia-ai-supercomputer\/\" target=\"_blank\" rel=\"noopener\">University of Florida\u2019s supercomputer, HiPerGator<\/a>. HiPerGator is one of the world\u2019s fastest AI supercomputers in academia, delivering 700 petaflops of AI performance, and was built with the support of NVIDIA founder and UF alumnus Chris Malachowsky and hardware, software, training and services from NVIDIA.<\/p>\n<p>The AI model\u2019s output is compiled into a database that feeds into a web portal, which shows information \u2014 including the safety assessment score, building type and even roof or wall material \u2014 in a map-based format.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-67651\" src=\"https:\/\/blogs.nvidia.com\/wp-content\/uploads\/2023\/10\/streetviewscreenshot.png\" alt=\"\" width=\"1757\" height=\"787\"><\/p>\n<p>Wang\u2019s work was funded by the <a href=\"https:\/\/www.nvidia.com\/en-us\/industries\/higher-education-research\/applied-research-program\/\" target=\"_blank\" rel=\"noopener\">NVIDIA Applied Research Accelerator Program<\/a>, which supports research projects that have the potential to make a real-world impact through the deployment of NVIDIA-accelerated applications adopted by commercial and government organizations.<\/p>\n<h2><strong>A Helping Eye<\/strong><\/h2>\n<p>Wang says that the portal can serve different needs depending on the use case. To prepare for a natural disaster, a government can use predictions solely from street view images.<\/p>\n<p>\u201cThose are static images \u2014 one example is Google Street View images, which get updated every several years,\u201d he said. \u201cBut that\u2019s good enough for collecting information and getting a general understanding about certain statistics.\u201d<\/p>\n<p>But for rural areas or developing regions, where such images aren\u2019t available or not frequently updated, governments can collect the images themselves. Powered by NVIDIA GPUs, the timely delivery of building assessments can help accelerate analyses.<\/p>\n<p>Wang also suggests that with enough refinement, his research could also create ripples for the urban planning and insurance industries.<\/p>\n<p>The project is currently being tested by a few local governments in Mexico and is garnering interest in some African, Asian and South American countries. At its current state, it can achieve over 85% accuracy in its assessment scores, per \u200cFEMA P-154 standards.<\/p>\n<h2><b>Survey of the Land<\/b><\/h2>\n<p>One challenge Wang cites is the variation in urban landscapes in different countries. Different regions have their own cultural and architectural styles. Not trained on a large or diverse enough pool of images, the AI model could be thrown off by factors like paint color when performing wall material analysis. Another challenge is urban density variation.<\/p>\n<p>\u201cIt is a very general limitation of current AI technology,\u201d Wang said. \u201cIn order to be useful, it requires enough training data to represent the distribution of the real world, so we\u2019re putting efforts into the data collection process to solve the generalization issue.\u201d<\/p>\n<p>To overcome this challenge, Wang aims to train and test the model for more cities. So far, he\u2019s tested about eight cities in different countries.<\/p>\n<p>\u201cWe need to generate more detailed and high-quality annotations to train the model with,\u201d he said. \u201cThat is the way we can improve the model in the future so that it can be used more widely.\u201d<\/p>\n<p>Wang\u2019s goal is to get the project to a point where it can be deployed as a service for more general industry use.<\/p>\n<p>\u201cWe are creating application programming interfaces that can estimate and analyze buildings and households to allow seamless integration with other products,\u201d he said. \u201cWe are also building a user-friendly application that all government agencies and organizations can use.\u201d<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>https:\/\/blogs.nvidia.com\/blog\/2023\/10\/23\/street-view-image-deep-learning-research-urban-building\/<\/p>\n","protected":false},"author":0,"featured_media":3230,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[],"_links":{"self":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/3229"}],"collection":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/comments?post=3229"}],"version-history":[{"count":0,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/3229\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media\/3230"}],"wp:attachment":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media?parent=3229"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/categories?post=3229"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/tags?post=3229"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}