Hundreds of thousands of ChatGPT users exhibit signs of psychosis, mania, or suicidal intent every week, a company audit indicates.1
The finding, released as part of an update to the AI technology to better detect these types of conversations, comes amid a wider debate on how chatbots could exacerbate mental health problems.
OpenAI, ChatGP’s developer, estimated that around 0.07% of users in a given week show possible signs of mental health emergencies related to psychosis or mania. Additionally, 0.15% of users had conversations with explicit indicators of potential suicidal planning or intent.
Although the overall percentages are small, ChatGPT has recorded as many as 800 million active users in a week, meaning the figures represent a huge number of individuals. Scaled up, they mean that each week around 1.2 million users are considering suicide and 560 000 are showing signs of psychosis or mania per week.
OpenAI recently updated ChatGPT after consultation …
