Skip to content
INTELLIGENCE BEAT2 Briefs

Amazon

2 Briefs

Verified technical decision briefs tracking amazon developments

Filter:

AWS rolls out Bedrock AgentCore V2 with sub-2-second cold starts

Topographic elevation contour card for AWS rolls out Bedrock AgentCore V2 with sub-2-second cold starts

What happened.Amazon Web Services launched Platform Version V2 of the Amazon Bedrock AgentCore runtime, reducing agent container cold starts to under two seconds using Firecracker microVM memory snapshots.

Why it matters.Heavy container initialization latencies previously forced engineering teams to maintain expensive warm virtual machines for unpredictable agent tasks. Enabling sub-two-second cold starts with automated scale-to-zero compute reduces infrastructure expenditures while preserving rapid interactive responsiveness.

↳Continues: AWS adds prompt caching for open-weight models on Bedrock
Read Full Brief →
Source:AWS (opens in a new tab)
All Stories1 story
Decision brief card for AWS adds prompt caching for open-weight models on Bedrock

AWS adds prompt caching for open-weight models on Bedrock

What happened.Amazon Web Services launched prompt caching for open-weight foundation models on Amazon Bedrock, reducing inference latency by up to 85 percent and cutting input costs by 90 percent.

Why it matters.Multi-step reasoning loops repeatedly feed system prompts, schema definitions, and conversation histories into foundation models. Applying server-side prompt caching to open-weight models allows developers to deploy complex tool-calling agents without incurring linear token fee growth.

  • Latency reduction: Speeds up response times by up to 85 percent for extended conversational contexts and repetitive agent retrieval prompts.
  • Cost savings: Cuts input token processing charges by 90 percent on cached prefix tokens across supported model checkpoints.
  • Model support: Available immediately for Llama 3.3 70B, Mistral Large 2, and Command R+ endpoints across standard AWS commercial regions.
  • Cache invalidation: Automatically manages cache eviction using a 5-minute time-to-live policy that refreshes dynamically whenever a matching prompt prefix arrives.
Official Source:Amazon Web Services
Decision brief card for AWS adds prompt caching for open-weight models on Bedrock
Read Brief
Source:Amazon Web Services (opens in a new tab)