AWS now allows prompt caching with 90% cost reduction

AWS added Intelligent Prompt Routing and Prompt Caching to Bedrock in hopes of getting model usage prices down.Read More