This $800M Startup Makes ChatGPT 24x Faster

Every time ChatGPT takes three seconds to respond instead of 30, there’s probably infrastructure like vLLM working behind the scenes. You’ve been using it without knowing it. And now, the team behind it just became an $800 million company overnight.Here are the detailsToday, Inferact launched with a massive $150 million seed round to commercialize the open-source inference engine that’s already powering AI at Amazon, major cloud providers, and thousands of developers world