AWS

How Airbnb uses cost per task to operate coding agents on Amazon Bedrock

ML-22452-featured-image

Amazon Bedrock provides access to foundation models from multiple providers through a common API, with AWS managing the model infrastructure. It integrates with AWS access controls and monitoring, and processes prompts, code, and model responses within AWS. As coding agents move into production, changes in models and usage can affect latency, capacity, and cost. Amazon Bedrock runtime metrics in Amazon CloudWatch help teams investigate latency increases, throttling, and changes in token consumption. Evaluations, or evals, complement these operational metrics by assessing the quality of an agent’s work on a fixed set of representative tasks. In this post, we show how Airbnb evaluates models for coding agents and…

Continue reading at AWS aws.amazon.com
Advertisement