ElevenLabs exploring new frontiers of voice AI after complaints of abuse

ElevenLabs, a research lab exploring new frontiers of Voice AI, is exploring ways to implement additional safeguards after Prime Voice AI led to an increasing number of voice cloning misuse cases. What Happened: ElevenLabs official Twitter handle posted a series of tweets informing users about the significant number of voice cloning abuse that has happened since its beta platform launched.

See Also: Why Munster thinks Microsoft-Open AI s Expanded Deal Is A Smart Move — Hint: It Has To Do With Google

The company stated that they could track any generated audio back to users who misused the technology, but they also d address the issue by implementing additional safeguards. The tweets came after it was reported that many users and trollers were using ElevenLabs Prime Voice AI to create hateful messages using deepfake celebrity voices, according to Gizmodo.

Why It is Important: The company first released its text-to-voice open beta platform on January 23, allowing users to clone voices from audio samples.

According to Motherboard, a 4 Chan user posted a clip of Harry Potter fame Emma Watson reading a passage from Mein Kampf - the 1925 autobiographical manifesto by Adolf Hitler. Other 4chan users have also uploaded deep-fake voices of celebrities like Robin Williams and Joe Rogan.

The report noted that Rick and Morty co-creator Justin Roiland's titular character Rick Sanchez was reportedly used to pose as he talked about beating his wife. Roiland is currently facing domestic abuse charges.

Read Next: ChatGPT Is Doing for AI What Apple s iPhone did for Smartphones?