Sakana AI's CTO says he's 'absolutely sick' of transformers, the tech that powers every major AI model

In a striking act of self-critique, one of the architects of the transformer technology that powers ChatGPT, Claude, and virtually every major AI system told an audience of industry leaders this week that artificial intelligence research has become dangerously narrow — and that he's moving on from his own creation.Llion Jones, who co-authored the seminal 2017 paper "Attention Is All You Need" and even coined the name "transformer," delivered an unusually candid assessment at the TED AI con