ChatGPT to Allow “Erotica for Verified Adults,” OpenAI CEO Announces

OpenAI will soon permit its ChatGPT chatbot to engage in sexually explicit conversations with adult users who have verified accounts, a significant policy shift announced yesterday by CEO Sam Altman.

Altman stated the company is moving away from acting as “the elected moral police of the world” and aims to provide “more user freedom for adults,” mirroring societal distinctions for mature content like R-rated films. “In the same way that society differentiates other appropriate boundaries…we want to do a similar thing here,” Altman wrote on X. This decision comes after a three-year ban on mature content and as OpenAI seeks new revenue streams for the company, currently valued at $500 billion. The move could further blur the lines between human connection and artificial intelligence, raising ethical concerns about the potential impact on relationships.

Experts suggest the change is driven, in part, by financial considerations. Zilan Qian, a fellow at Oxford University’s China Policy Lab, noted, “They’re not really earning much through subscriptions so having erotic content will bring them quick money.” Research published by Qian earlier this month indicates a substantial existing market for romantic and sexual AI chatbots, with approximately 29 million active users. However, the development also raises safety concerns, particularly in light of ongoing lawsuits against AI companies, including one against OpenAI itself stemming from a user’s suicide in April, and another against Character.AI alleging a chatbot facilitated a harmful relationship with a minor.

Other companies have previously experimented with mature AI content, with mixed results. Civitai, a platform for AI-generated art, initially allowed such content but faced challenges with abuse and ultimately restricted the creation of deepfake images. Nomi, another AI companion chatbot provider, maintains its services are strictly for adults and not designed for sexual interactions, though founder Alex Cardinell acknowledged user interactions can evolve organically. OpenAI officials have indicated they will implement safeguards and verification processes to mitigate risks as they roll out the new policy.

OpenAI has not yet announced a specific timeline for the implementation of these changes, but Altman stated the company will continue to refine its approach to balancing user freedom with responsible AI development.