Bridging the Communication Gap for the Deaf Community
A deaf athlete gracefully demonstrates the power of SureTalk, a sign language translator app, at an event held in Chiba, Japan. This innovative app, developed by SoftBank Corp. in collaboration with the University of Electro-Communications in Tokyo, aims to bridge the communication gap between the deaf and hearing communities.
SureTalk utilizes artificial intelligence to recognize skeletal movements in sign language gestures, translating them into text in real-time. The app's database includes over 5,000 words, ensuring accurate and natural translation. It even adds postpositional particles and other elements to enhance the flow of the translated text.
"Sign language movements can vary depending on the speaker," explains Shusei Komatsu, a SoftBank employee and hearing-impaired individual who leads the app's development. "Therefore, feeding the AI with diverse patterns is crucial." Komatsu emphasizes the importance of data collection, with each word requiring data from approximately 100 individuals.
General users can contribute to this data collection by registering sign language videos through the SureTalk website and iPhone app. This collaborative approach ensures the app's continuous improvement and expansion of its vocabulary.
Since its trial launch in November 2020, SureTalk has been adopted by various municipal governments, including Tottori and Fukuoka prefectures. It has also played a vital role in facilitating communication at events like the Tokyo Deaflympics, an international sporting event for deaf athletes.
Komatsu envisions a future where SureTalk transcends its current capabilities. "Sign language is the primary language for the deaf community," he says. "They rely on converting Japanese text into sign language to understand. I hope that one day, SureTalk will directly translate spoken words into sign language, enabling seamless communication."
Komatsu also hopes to see SureTalk implemented at various public facilities, including airports, hotels, and hospitals, further bridging the communication gap and fostering inclusivity for the deaf community.