The Controversy Over ChatGPT's Sky Voice: When Flirty Becomes Unsettling

In the rapidly evolving world of AI, OpenAI's recent voice updates for ChatGPT have generated significant buzz, particularly around the voice named "Sky." Despite the excitement, this development has drawn criticism and controversy, leading OpenAI to temporarily halt the use of this voice.User Reactions and Comparisons to Scarlett JohanssonUpon its release, many users noted the striking similarity between Sky's voice and Scarlett Johansson's character in the 2013 film Her. This resemblance was not just in tone but also in the flirty, seductive mannerisms of the voice, which some users found off-putting. Social media was abuzz with comparisons and jokes, with many people and even referring to it as "Her come to life."Feedback and ConcernsThe feedback was swift and clear: while some users enjoyed the lifelike quality of Sky's voice, others found it too flirty and unprofessional.Concerns were raised about the implications of such a voice, especially in professional or educational settings. Critics argued that the overly seductive tone reinforced harmful gender stereotypes and was inappropriate for many use cases. A headline in the Evening Standard read: "Digital love: ChatGPT users worried they'll fall for 'flirty' new GPT-4o AI with female voice."OpenAI’s ResponseIn light of the significant amount of feedback, OpenAI acknowledged that the voice was indeed problematic for many users. They clarified that the voice was not Scarlett Johansson's and emphasized the importance of user feedback in refining their products. CEO Sam Altman addressed the issue on social media, referencing the film Her and acknowledging the unintended consequences of the voice's design.After watching the OpenAI live demos last Monday, I played the "Sky" voice for my husband. "What do you think of this voice?" I asked, confessing that I was not a fan of her giggling. I believe the exact words I used were 'degrading to women everywhere.' My husband listened and compared the voice to a "20 year old who's had too much to drink."The intention behind creating a relatable and engaging voice may have been well-meaning, but it highlights the broader issue of gender representation in AI. Voices that are overly flirty or giggly can perpetuate stereotypes that women often face in both virtual and real-life interactions. I found myself wondering: Didn't the women on the OpenAI Dev team raise this concern? Were they not asked, or were their opinions disregarded?As The Daily Host Show host joked: “You can really tell that a man built this tech,” the Daily Show host Desi Lydic joked last week. “She’s like, ‘I have all the information in the world, but I don’t know anything.’”Moving ForwardRegardless of the fumble OpenAI made in using flirty Sky for their demo, they are correcting their course now.In a May 19th blog entry entitled: "How the Voices For ChatGPT Were Chosen," OpenAI spells out the process they went through to choose their five voices.OpenAI clarifies that Sky is not Scarlett J: "We believe that AI voices should not deliberately mimic a celebrity's distinctive voice—Sky’s voice is not an imitation of Scarlett Johansson but belongs to a different professional actress using her own natural speaking voice. To protect their privacy, we cannot share the names of our voice talents."The Future of Voice Mode For GPT-4oAs per previous announcements, VoiceMode will be coming to Plus users first: "We plan to give access to a new Voice Mode for GPT-4o(opens in a new window) in alpha to ChatGPT Plus users in the coming weeks. With GPT-4o, using your voice to interact with ChatGPT is much more natural. GPT-4o handles interruptions smoothly, manages group conversations effectively, filters out background noise, and adapts to tone." - OpenAI, May 19th blog.Kudos to OpenAI for Halting "Sky"OpenAI's decision to halt the use of the Sky voice demonstrates their commitment to responsible AI development. The company is now focusing on ensuring their voices meet a broader range of user expectations without crossing lines into discomfort or inappropriateness. This episode serves as a reminder of the power and responsibility that comes with creating technology that interacts with humans on such a personal level.OpenAI ends their blog post with a promise of diversity: "Looking ahead, you can expect even more options as we plan to introduce additional voices in ChatGPT to better match the diverse interests and preferences of users."For a deeper dive into OpenAI's process for selecting and refining their voices, you can read the original blog post.Stay Curious. Stay Informed. #DeepLearningDailyAuthored by Diana Wolf Torres, a freelance writer, illuminating the intersection of human wisdom and AI advancement.Editor's Note: In an earlier version of this article, I said that OpenAI had "ditched" the Sky voice. This is incorrect. OpenAI is halting the Sky voice and revamping it based on user feedback.Additional Resources for Inquisitive MindsHow the voices for ChatGPT were chosen. OpenAI Blog. May 19, 2024.OpenAI's flirty new GPT-4o is giving some people the ick. Beatrice Nolan. Business Insider. (May 15, 2024.)ChatGPT suspends AI voice that sounds like Scarlett Johansson. OpenAI says ‘Sky’ is not an imitation of actor’s voice after users compare it to AI companion character in film Her. Nick Robins-Early. The Guardian. (May 20, 2024.)Is that 'Her'? OpenAI pauses a ChatGPT voice after some say it sounds like Scarlett Johansson. ABC News. (May 20, 2024.)Introducing GPT40. Video. OpenAI. (May 13, 2024.)Short video of the Sky voice from OpenAI on Twitter/X. May 13, 2024.ChatGPT can now see, hear, and speak. OpenAI Blog. September 25, 2023.Video: "How I Use ChatGPT Voice To Learn." Diana Wolf Torres. Deep Learning Daily. (April 20, 2024.)Bonus Content:How To Change Voices Within The ChatGPT Voice AppWhile in the ChatGPT Voice App, tap the three dots in the lower corner to go into Settings. Then, under speech, choose: "Voice." I am looking forward to trying the new version of ChatGPT Voice when it rolls out in the upcoming weeks.#AI #ChatGPT #OpenAI #VoiceTech #ArtificialIntelligence #TechNews #EthicsInAI #GenderRepresentation #Innovation #UserFeedback #VoiceTechnology #AIResearch #ResponsibleAI This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit dianawolftorres.substack.com