Developersummit
  • HOME
  • SPEAKERS
  • SESSIONS
  • SCHEDULE
  • FAQ
  • BUY TICKETS
  • ONDEMAND
  • CONTACT
saltmarch

GIDS news media, articles, insights and virtual events educate and illuminate its audiences so they can be fully prepared to deal with the new realities at work and in their professions.

Saltmarch On-Demand
Media

Our Experts

Videos On Demand

Insights

Call for Papers

Connect

About Us

Privacy Policy

Terms & Conditions

Contact Us

Subscribe to Developersummit

Get the latest event updates, and insights from today's leading voices.

© 2026-2027 Saltmarch. All rights reserved.

The Hidden Cost of AI Agents: Designing for Predictable Spend at Scale
RegisterTwitterLinkedInFacebook

< session />

The Hidden Cost of AI Agents: Designing for Predictable Spend at Scale

Tue, April 21DeepTech OpsTech Architecture

AI agents do not fail because they cannot reason. They fail because the cost of their behaviour is not designed upfront. What begins as a simple agentic workflow with a planner, tools, and retrieval quickly grows into a system of chained calls, recursive loops, repeated memory access, and cascading model invocations. Each step may appear inexpensive, but at scale the combined cost becomes significant. For enterprise systems, this unpredictability is a critical risk.

This session examines the unit economics of agentic AI systems in production. Drawing from real deployments, it identifies where costs accumulate, including orchestration overhead from uncontrolled reasoning loops, excessive tool calls due to poorly defined boundaries, context window growth from unmanaged memory, and escalation from multi-agent coordination. The session also presents practical approaches to address these challenges, including agent loop budgeting, tiered model routing for sub-tasks, caching strategies for tool outputs, and observability patterns that make spend predictable.

What You Will Learn

  • Where cost accumulates in agentic AI systems, including loops, tool calls, and memory usage
  • How to design agent workflows with budgeting, routing, and caching to control spend
  • How to apply observability patterns to make AI agent costs predictable at scale

Who Should Attend

  • Software developers building AI agent systems
  • AI and machine learning engineers
  • Platform and infrastructure engineers
  • Software architects
  • Engineering and technology leaders responsible for cost and scalability

< speaker_info />

About the speaker

Akhil Jain

Akhil Jain

Senior Solutions Architect, Amazon Web Services

Akhil Jain is a Senior Solutions Architect at Amazon Web Services with 17+ years of experience across the USA and India, building and operationalizing AI systems at enterprise scale. He specializes in GenAI architecture, agentic workflows, LLM orchestration, IoT and Big Data — working hands-on with engineering teams to move AI from promising prototype to production-grade reality, within the real constraints of cost, latency, and data maturity.

Having worked directly with AWS customers across the USA, Canada, Mexico, El Salvador, the Netherlands, Australia, and India, Akhil brings a genuinely global perspective to enterprise technology — one shaped by firsthand experience of how AI adoption, cloud strategy and architectural decisions play out across different markets, industries and regulatory environments.
Before AWS, he led big data and cloud architecture programs at Informatica. A Carnegie Mellon alumnus, he believes GenAI's true potential lies not in benchmarks or demos — but in the lasting human impact it creates when built with purpose and deployed at scale.

His sessions are built on production reality — the tradeoffs, the failure modes and the hard numbers that practitioners actually encounter when scaling AI beyond the demo.

Related Talks

Why AI Agents Love Knowledge Graphs

Thu, April 23

Why AI Agents Love Knowledge Graphs

Zaid Zaim
Spring into AI

Fri, April 24

Spring into AI

Venkat Subramaniam
Computer Programming is Dead; Long Live AI-First Programming

Tue, April 21

Computer Programming is Dead; Long Live AI-First Programming

Stephen Chin, Cassandra Chin

On-Demand Talks

A View from the Top: Introducing Developers to the Future of Software with Agentic AI

A View from the Top: Introducing Developers to the Future of Software with Agentic AI

Mani Chandrasekaran
AI and Developers: Revolutionizing Problem Solving

AI and Developers: Revolutionizing Problem Solving

Bhuvanesh Jain
Vector Search on the Edge: Powering Mobile and IoT with AI

Vector Search on the Edge: Powering Mobile and IoT with AI

Shivay Lamba
Architecture Patterns for AI-Powered Applications

Architecture Patterns for AI-Powered Applications

Michael Carducci
Unleashing Technologies that will Transform IoT

Unleashing Technologies that will Transform IoT

Vishweshwar Hegde
Machine Learning Attacks – A New Era of Security Epidemic

Machine Learning Attacks – A New Era of Security Epidemic

Ashima Purohit
All On-Demand »