How “reverse game theory” could keep AI agents in check

A new approach known as “reverse game theory” aims to create incentives for powerful AI models that make following the rules the most rational choice.As AI models become more capable, safety researchers are scrambling to ensure they are “aligned” with human desires—to make sure, in other words, that rogue agents don’t break the law, hack into unauthorized servers, or release poison gas into major cities and kill us all.Until now, this work has mostly focused on trying to peer into a