{"id":3905,"date":"2025-02-20T14:50:44","date_gmt":"2025-02-20T14:50:44","guid":{"rendered":"https:\/\/salarydistribution.com\/machine-learning\/2025\/02\/20\/its-a-sign-ai-platform-for-teaching-american-sign-language-aims-to-bridge-communication-gaps\/"},"modified":"2025-02-20T14:50:44","modified_gmt":"2025-02-20T14:50:44","slug":"its-a-sign-ai-platform-for-teaching-american-sign-language-aims-to-bridge-communication-gaps","status":"publish","type":"post","link":"https:\/\/salarydistribution.com\/machine-learning\/2025\/02\/20\/its-a-sign-ai-platform-for-teaching-american-sign-language-aims-to-bridge-communication-gaps\/","title":{"rendered":"It\u2019s a Sign: AI Platform for Teaching American Sign Language Aims to Bridge Communication Gaps"},"content":{"rendered":"<div>\n\t\t<span class=\"bsf-rt-reading-time\"><span class=\"bsf-rt-display-label\"><\/span> <span class=\"bsf-rt-display-time\"><\/span> <span class=\"bsf-rt-display-postfix\"><\/span><\/span><\/p>\n<p>American Sign Language is the third most prevalent language in the United States \u2014 but there are vastly fewer AI tools developed with ASL data than data representing the country\u2019s most common languages, English and Spanish.<\/p>\n<p>NVIDIA, the American Society for Deaf Children and creative agency Hello Monday are helping close this gap with Signs, an interactive web platform built to support ASL learning and the development of accessible AI applications.<\/p>\n<p>Sign language learners can access the platform\u2019s validated library of ASL signs to expand their vocabulary with the help of a 3D avatar that demonstrates signs \u2014 and use an AI tool that analyzes webcam footage to receive real-time feedback on their signing. Signers of any skill level can contribute by signing specific words to help build an open-source video dataset for ASL.<\/p>\n<\/p>\n<p>The dataset \u2014 which NVIDIA aims to grow to 400,000 video clips representing 1,000 signed words \u2014 is being validated by fluent ASL users and interpreters to ensure the accuracy of each sign, resulting in a high-quality visual dictionary and teaching tool.<\/p>\n<p>\u201cMost deaf children are born to hearing parents. Giving family members accessible tools like Signs to start learning ASL early enables them to open an effective communication channel with children as young as six to eight months old,\u201d said Cheri Dowling, executive director of the American Society for Deaf Children. \u201cAnd knowing that professional ASL teachers have validated all the vocabulary on the platform, users can be confident in what they\u2019re learning.\u201d<\/p>\n<p>NVIDIA teams plan to use this dataset to further develop AI applications that break down communication barriers between the deaf and hearing communities. The data is slated to be available to the public as a resource for building accessible technologies including AI agents, digital human applications and video conferencing tools. It could also be used to enhance Signs and enable ASL platforms across the ecosystem with real-time, AI-powered support and feedback.<\/p>\n<figure id=\"attachment_77923\" aria-describedby=\"caption-attachment-77923\" class=\"wp-caption aligncenter\"><img decoding=\"async\" loading=\"lazy\" class=\"size-medium wp-image-77923\" src=\"https:\/\/blogs.nvidia.com\/wp-content\/uploads\/2025\/02\/signing-still-960x509.jpg\" alt=\"Three people practicing sign language using Signs AI platform\" width=\"960\" height=\"509\"><figcaption id=\"caption-attachment-77923\" class=\"wp-caption-text\">Whether novice or expert, volunteers can record themselves signing to contribute to the ASL dataset.<\/figcaption><\/figure>\n<h2><b>Supporting ASL Education, Exploring Language Nuance<\/b><\/h2>\n<p>During the data collection phase, Signs already provides a powerful platform for ASL language acquisition, offering opportunities for individuals to learn and practice an initial set of 100 signs so they can more effectively communicate with friends or family members who use ASL.<\/p>\n<p>\u201cThe Signs learning platform could help families with deaf children quickly search for a specific word and see how to make the corresponding sign. It\u2019s a tool that can help support their everyday use of ASL outside of a more formal class,\u201d Dowling said. \u201cI see both kids and parents exploring it \u2014 and I think they could play with it together.\u201d<img decoding=\"async\" loading=\"lazy\" class=\"alignright wp-image-77931 \" src=\"https:\/\/blogs.nvidia.com\/wp-content\/uploads\/2025\/02\/signing-vegetable-still-1-960x644.jpg\" alt='person signing the word \"vegetable\" using Signs AI platform' width=\"448\" height=\"300\"><\/p>\n<p>While Signs currently focuses on hand movements and finger positions for each sign, ASL also incorporates facial expressions and head movements to convey meaning. The team behind Signs is exploring how these non-manual signals can be tracked and integrated in future versions of the platform.<\/p>\n<p>They\u2019re also investigating how other nuances, like regional variations and slang terms, can be represented in Signs to enrich its ASL database \u2014 and working with researchers at the Rochester Institute of Technology\u2019s Center for Accessibility and Inclusion Research to evaluate and further improve the user experience of the Signs platform for deaf and hard-of-hearing users.<\/p>\n<p>\u201cImproving ASL accessibility is an ongoing effort,\u201d said Anders Jessen, founding partner of Hello Monday\/DEPT, which built the Signs web platform and previously worked with the American Society for Deaf Children on <a target=\"_blank\" href=\"https:\/\/fingerspelling.xyz\/\" rel=\"noopener\">Fingerspelling.xyz<\/a>, an application that taught users the ASL alphabet. \u201cSigns can serve the need for advanced AI tools that help transcend communication barriers between the deaf and hearing communities.\u201d<\/p>\n<p>The dataset behind Signs is planned for release later this year.<\/p>\n<p>Start learning or contributing with Signs at <a target=\"_blank\" href=\"https:\/\/signs-ai.com\/\" rel=\"noopener\">signs-ai.com<\/a>, and learn more about <a target=\"_blank\" href=\"https:\/\/www.nvidia.com\/en-us\/ai-data-science\/trustworthy-ai\/\" rel=\"noopener\">NVIDIA\u2019s trustworthy AI initiatives<\/a>. Attendees of <a target=\"_blank\" href=\"https:\/\/www.nvidia.com\/gtc\/\" rel=\"noopener\">NVIDIA GTC<\/a>, a global AI conference taking place March 17-21 in San Jose, will be able to participate in Signs live at the event.<\/p>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"<p>https:\/\/blogs.nvidia.com\/blog\/ai-sign-language\/<\/p>\n","protected":false},"author":0,"featured_media":3906,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[],"_links":{"self":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/3905"}],"collection":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/comments?post=3905"}],"version-history":[{"count":0,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/3905\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media\/3906"}],"wp:attachment":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media?parent=3905"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/categories?post=3905"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/tags?post=3905"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}