Most of the companies behind large language models like ChatGPT claim to have guardrails in place for understandable reasons. They wouldn’t want their models to, hypothetically, offer instructions to users on how to hurt themselves or commit suicide.
AI can help you die by suicide if you ask the right way, researchers say
