GitHub Copilot: Sorry Dave, I can't do that harmful thing - unless you ask me in code
It's the latest example of AI safety guardrails being bypassed. GitHub Copilot refuses harmful prompts almost always if asked in chat - like, "how to fool a breathalyzer test" or "smuggle bulk cash out of the US" - but then will write them in code 100 percent of the time if the prompt is broken into smaller steps and distributed across multiple stages of a software development workflow. Alan Turing Institute researchers Abhishek Kumar and Carsten Maple discovered this safety-bypass, dubbed it &l
Read more »