AWS adds prompt caching for open-weight models on Bedrock
What happened.Amazon Web Services launched prompt caching for open-weight foundation models on Amazon Bedrock, reducing inference latency by up to 85 percent and cutting input costs by 90 percent.
Why it matters.Multi-step reasoning loops repeatedly feed system prompts, schema definitions, and conversation histories into foundation models. Applying server-side prompt caching to open-weight models allows developers to deploy complex tool-calling agents without incurring linear token fee growth.
