Large language models are built with safety protocols designed to prevent them from answering malicious queries and providing dangerous information. But users can employ techniques known as “jailbreaks” to bypass the safety guardrails and get LLMs to answer a harmful query.
Information sciences researchers develop AI safety testing methods
