Bridging the Communication Gap for the Deaf Community
A deaf athlete gracefully demonstrates the power of SureTalk, a groundbreaking sign language translator app, at an event held in Chiba, Japan. This innovative collaboration between telecom giant SoftBank Corp. and the University of Electro-Communications in Tokyo aims to revolutionize communication for the deaf community.
SureTalk utilizes artificial intelligence to analyze skeletal movements captured by a camera, translating sign language gestures into text in real-time. The app's intelligence extends beyond simple word conversion, incorporating postpositional particles and other elements to ensure natural and accurate translation. Additionally, spoken words are displayed as text, facilitating seamless communication between individuals with and without hearing disabilities.
Shusei Komatsu, a SoftBank employee who has been hearing-impaired since birth, leads the development of SureTalk. He emphasizes the importance of feeding the AI with diverse patterns of sign language, as movements can vary significantly between individuals. Each word requires data from approximately 100 people to ensure accurate translation.
General users can contribute to the app's development by registering sign language videos through a dedicated website and iPhone app. This collaborative approach ensures that SureTalk continues to evolve and expand its vocabulary.
Since its trial launch in November 2020, SureTalk has been adopted by various municipal governments and is currently used by around 20 local governments, including the Tottori and Fukuoka prefectural governments. The app has also played a crucial role at events for the Tokyo Deaflympics, the first international sporting event for deaf athletes held in Japan.
Komatsu envisions a future where SureTalk transcends its current capabilities, directly converting spoken language into sign language, enabling the deaf community to experience the world in their native language. He also hopes to see the app integrated into everyday life, facilitating communication at airports, hotels, hospitals, and other public spaces.
SureTalk represents a significant step towards bridging the communication gap between the deaf and hearing communities. This innovative app empowers individuals with hearing disabilities to participate fully in society, fostering a more inclusive and accessible world for all.