Developersummit
  • HOME
  • SPEAKERS
  • SESSIONS
  • SCHEDULE
  • FAQ
  • BUY TICKETS
  • ONDEMAND
  • CONTACT
saltmarch

GIDS news media, articles, insights and virtual events educate and illuminate its audiences so they can be fully prepared to deal with the new realities at work and in their professions.

Saltmarch On-Demand
Media

Our Experts

Videos On Demand

Insights

Call for Papers

Connect

About Us

Privacy Policy

Terms & Conditions

Contact Us

Subscribe to Developersummit

Get the latest event updates, and insights from today's leading voices.

© 2026-2027 Saltmarch. All rights reserved.

The Hidden Cost of AI Agents: Designing for Predictable Spend at Scale
RegisterTwitterLinkedInFacebook

< session />

The Hidden Cost of AI Agents: Designing for Predictable Spend at Scale

Tue, April 21 at 12:10 PM - 12:40 PM GMT+5:30DeepTech OpsTech Architecture

AI agents do not fail because they cannot reason. They fail because the cost of their behaviour is not designed upfront. What begins as a simple agentic workflow with a planner, tools, and retrieval quickly grows into a system of chained calls, recursive loops, repeated memory access, and cascading model invocations. Each step may appear inexpensive, but at scale the combined cost becomes significant. For enterprise systems, this unpredictability is a critical risk.

This session examines the unit economics of agentic AI systems in production. Drawing from real deployments, it identifies where costs accumulate, including orchestration overhead from uncontrolled reasoning loops, excessive tool calls due to poorly defined boundaries, context window growth from unmanaged memory, and escalation from multi-agent coordination. The session also presents practical approaches to address these challenges, including agent loop budgeting, tiered model routing for sub-tasks, caching strategies for tool outputs, and observability patterns that make spend predictable.

What You Will Learn

  • Where cost accumulates in agentic AI systems, including loops, tool calls, and memory usage
  • How to design agent workflows with budgeting, routing, and caching to control spend
  • How to apply observability patterns to make AI agent costs predictable at scale

Who Should Attend

  • Software developers building AI agent systems
  • AI and machine learning engineers
  • Platform and infrastructure engineers
  • Software architects
  • Engineering and technology leaders responsible for cost and scalability

< speaker_info />

About the speaker

Anannya Roy Chowdhury

Anannya Roy Chowdhury

Gen AI Developer Advocate & Architect, AWS

Anannya Roy is a Generative AI Architect and Developer Advocate at Amazon Web Services, where she builds production-grade LLM and agentic AI systems for enterprise use. With 8+ years of experience across software engineering, data science, and AI, she specializes in multi-agent architectures, RAG pipelines, and scalable AI systems.

She previously led award-winning GenAI platforms at Capgemini, delivering measurable impact across industries. Anannya is an active speaker and workshop leader, helping developers move from experimentation to production, with a strong focus on reliability, observability, and responsible AI.

Related Talks

It Works in the Demo. Will It Work in Production? Evaluating and Debugging AI Agents

Fri, April 24

It Works in the Demo. Will It Work in Production? Evaluating and Debugging AI Agents

Apurva Misra
Harnessing Event-Driven and Multi-Agentic Approaches for Efficient AI Data Flows

Thu, April 23

Harnessing Event-Driven and Multi-Agentic Approaches for Efficient AI Data Flows

Mary Grygleski
The Ferrari in the Jungle: Orchestrating AI-Native Engineering in the Enterprise

Thu, April 23

The Ferrari in the Jungle: Orchestrating AI-Native Engineering in the Enterprise

Sunit Parekh

On-Demand Talks

AI in the Trenches: Engineering Real-World Systems at the Edge of Innovation

AI in the Trenches: Engineering Real-World Systems at the Edge of Innovation

Stephen Chin, Mark Richards, Archie Sharma, Vanya Seth, Michael Carducci
The Knowledge Graph - The Story from Daydream to Reality

The Knowledge Graph - The Story from Daydream to Reality

Michael Carducci
Building Hierarchical Multi-Agent RAG Systems

Building Hierarchical Multi-Agent RAG Systems

Raghavan Narasimhan
AI Assistance for On-Call Engineer

AI Assistance for On-Call Engineer

Paranth Thiruvengadam
Generative AI Impact on Enterprises

Generative AI Impact on Enterprises

Rajdeep Dua
The Art of Conversation (Design)

The Art of Conversation (Design)

Amy Cleary
All On-Demand »