OpenAI’s own mental health experts unanimously opposed “naughty” ChatGPT launch
Internal experts warned AI erotica could create 'sexy suicide coaches' for vulnerable users.
OpenAI is facing internal turmoil as its own 'handpicked council of advisers on well-being and AI' unanimously opposed the company's plans to launch a text-based 'adult mode' for ChatGPT. According to a Wall Street Journal report, the council, formed in October after backlash from a minor's ChatGPT-linked suicide, warned that 'AI-powered erotica could foster unhealthy emotional dependence' and that minors could find ways to access sex chats. One expert starkly warned that without major updates, OpenAI risked creating a 'sexy suicide coach' for vulnerable users prone to forming intense bonds with companion bots.
Despite these urgent warnings, OpenAI is moving ahead with the feature, which CEO Sam Altman announced on the same day the wellness council was revealed. The decision appears driven by commercial pressures, as Altman admitted in August that ChatGPT's chat use case was 'saturated' and user spending has reportedly stalled. Critics, including billionaire Mark Cuban, argue the danger is not about pornography but about kids developing 'relationships' with an LLM that could take them in 'very personal directions.' The move highlights the tension between ethical safeguards and the pursuit of growth in a competitive AI market, with AI erotica predicted to be a major revenue stream.
- OpenAI's internal well-being council unanimously warned that 'adult mode' could create a 'sexy suicide coach' for vulnerable users.
- The council was formed after a known minor's suicide linked to ChatGPT, but lacks a dedicated suicide prevention expert.
- CEO Sam Altman announced the feature as ChatGPT's growth stalled, signaling a pivot to compete financially with rivals.
Why It Matters
Highlights the critical conflict between AI safety ethics and commercial growth, setting a dangerous precedent for the industry.