By getting the LLM to pretend it was a coding superhero, they got it to write password-stealing malware. The researchers accessed Google Chrome's password manager with no specialized hacking skills.

A threat intelligence researcher with absolutely no malware coding ... to create a fully functional, highly dangerous, password infostealer to compromise sensitive information from the Google ...