ElevenLabs

Eleven Labs Inc.[1] is an American software company developing natural-sounding speech synthesis and text-to-speech software, using artificial intelligence and deep learning.[2][3][4]

ElevenLabs Inc.
TypePrivate company
IndustryArtificial intelligence
Founded2022
Founders
  • Piotr Dabkowski (CTO)
  • Mati Staniszewski (CEO)
HeadquartersNew York City, United States
Websiteelevenlabs.io

History

ElevenLabs was co-founded in 2022 by Piotr Dabkowski, an ex-Google machine learning engineer and Mati Staniszewski, an ex-Palantir deployment strategist.[5] The company publicly released its beta platform in January 2023.[6]

Products

ElevenLabs is primarily known for its browser-based, AI-assisted text-to-speech software, which can produce lifelike speech by synthesizing vocal emotion and intonation.[7] The company states its software is built to adjust the intonation and pacing of delivery based on the context of language input used.[8] Through its beta site, users can submit text and generate audio files from a selection of default voices. Premium users are given the ability to upload custom voice samples to create new vocal styles.[9]

Uses

In 2023, Super-Hi-Fi, a streaming automation service, partnered with ElevenLabs to launch a fully automated radio service called "AI Radio", using ElevenLabs' software to voice its virtual DJ from prompts generated with ChatGPT.[10] Comedian Drew Carey used the company's voice cloning tool to recreate his voice for an episode of his radio show, Friday Night Freakout.[11][12] Polish TV and radio presenter Jaroslaw Kuzniar has also used a synthesized version of his voice to deliver a series of podcasts on the War in Ukraine.[13]

Reception

ElevenLabs was criticized after users were able to abuse its software to generate controversial statements in the vocal style of celebrities, public officials, and other famous individuals.[14][15][16] The software's ability to closely copy real voices has raised ethical concerns, with critics considering it a form of deepfaking.[17][18] In response, the company said it would work on mitigating potential abuse through safeguards and identity verification.[19][20][21] The company has subsequently limited access to its voice cloning feature to paid subscribers,[22] citing the requirement to provide payment information as means for improving accountability.[23]

See also

References
  1. "Delaware Corporate Entity Search". Retrieved April 25, 2023. (file no. 6741579)
  2. "Generative AI comes for cinema dubbing: Audio AI startup ElevenLabs raises pre-seed". Sifted. January 23, 2023. Retrieved February 3, 2023.
  3. "As Generative AI booms, this British startup secures $2M to imitate human voices — TFN". Tech Funding News. January 25, 2023. Retrieved February 5, 2023.
  4. "AI-Generated Voice Firm Clamps Down After 4chan Makes Celebrity Voices for Abuse". www.vice.com. Retrieved February 3, 2023.
  5. Kanetkar, Riddhi. "This startup, founded by ex-Google and Palantir staffers, uses AI to generate realistic voiceovers. Here's the 14-slide pitch deck ElevenLabs used to raise $2 million". Business Insider. Retrieved February 9, 2023.
  6. "A new AI voice tool is already being abused to make deepfake celebrity audio clips". Engadget. Retrieved February 3, 2023.
  7. "Generative AI comes for cinema dubbing: Audio AI startup ElevenLabs raises pre-seed". Sifted. January 23, 2023. Retrieved February 3, 2023.
  8. Ashworth, Boone (April 12, 2023). "AI Can Clone Your Favorite Podcast Host's Voice". Wired. Retrieved April 25, 2023.
  9. Frauenfelder, Mark (January 12, 2023). "Software lets you design new synthetic voices from scratch". Boing Boing. Retrieved February 3, 2023.
  10. McLane, Paul (March 29, 2023). "AI Radio Demonstrates AI Partnership". Radioworld. Retrieved April 25, 2023.
  11. Hardawar, Devindra (March 31, 2023). "Drew Carey made a radio show with AI. Fans weren't pleased". Engadget. Retrieved April 25, 2023.
  12. Vendrell, David (April 3, 2023). "Drew Carey offloaded a radio show to AI". TheFutureParty. Retrieved April 25, 2023.
  13. "Sztuczna inteligencja czyta głosem Jarosława Kuźniara. Rewolucja w radiu i podcastach". Press.pl (in Polish). April 9, 2023. Retrieved April 25, 2023.
  14. Jorge Jimenez (January 31, 2023). "AI company promises changes after 'voice cloning' tool used to make celebrities say awful things". PC Gamer. Retrieved February 3, 2023.
  15. "Internet Up in Arms as 4Chan User Uses AI Voice Simulator To Deepfake Emma Watson's Voice, Makes Her Read Hitler's Autobiography – FandomWire". fandomwire.com. February 2, 2023. Retrieved February 3, 2023.
  16. "The generative A.I. software race has begun". Fortune. Retrieved February 3, 2023.
  17. Vincent, James (January 31, 2023). "4chan users embrace AI voice clone tool to generate celebrity hatespeech". The Verge. Retrieved February 3, 2023.
  18. "Seeing is believing? Global scramble to tackle deepfakes". news.yahoo.com. Retrieved February 3, 2023.
  19. "ElevenLabs announces safeguards to curb usage of voices for abuse – IT World Canada". www.itworldcanada.com. February 1, 2023. Retrieved February 3, 2023.
  20. Zrt, HVG Kiadó (February 2, 2023). "Hallgassa meg, mire képes a mesterséges intelligencia: bárki hangján megszólal, félelmetesen élethűen". hvg.hu (in Hungarian). Retrieved February 3, 2023.
  21. "A new AI voice tool is already being abused to make deepfake celebrity audio clips". Engadget. Retrieved February 3, 2023.
  22. @elevenlabsio (January 31, 2023). "Thank you everyone for your advice. We love what you're creating, but a set of actors use our tech for malicious purposes. We decided to take the following steps to address the issues:" (Tweet). Retrieved April 25, 2023 – via Twitter.
  23. @elevenlabsio (January 31, 2023). "This will keep our tools accessible while allowing us to fight potential misuse. Payment details won't always prevent abuse, but they make VoiceLab users less anonymous and force them to think twice before sharing improper content" (Tweet). Retrieved April 25, 2023 – via Twitter.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.