Building multi-tenant architectures for agentic AI on AWS - AWS Prescriptive Guidance

Building multi-tenant architectures for agentic AI on AWS

Aaron Sempf and Tod Golding, Amazon Web Services

July 2025 (document history)

Agentic AI represents a disruptive paradigm shift that requires organizations to rethink how to build, deliver, and operate their systems. The agentic model has teams exploring new ways to decompose systems into one or more agents that create new paths, possibilities, and values.

Much of the agentic discussion centers around the tools, frameworks, and patterns that are used to build and implement agents. We must not only adopt good tools to create agents but also new integration protocols, authentication strategies, and discovery mechanisms that can serve as the basis of agentic architectures.

While the number of agentic tools grows, teams must also consider how their agents address more traditional architecture challenges. Scale, noisy neighbor, resilience, cost, and operational efficiency are fundamental topics that must be evaluated when you're designing, building, and deploying agents. Regardless of how autonomous and smart agents might be, we must also ensure that they achieve economies of scale, efficiency, and agility that align with business needs.

This guide's goal is to explore various dimensions of agentic footprints. This includes reviewing various agent deployment and consumption patterns and highlighting different strategies for creating agents that address architectural goals. It also means looking at how agents might be consumed in a multi-tenant environment by introducing internal constructs that are typically required in a multi-tenant setting.

Intended audience

This guide is for architects, developers, and technology leaders who want to build AI-driven multi-tenant systems.

Objectives

This guide helps you do the following:

  • Understand multi-tenant agent deployments, exploring both siloed and pooled models, and how tenant context affects agent implementation

  • Explore agent management, including onboarding, tenant isolation, and resource management across single- and multi-provider environments

  • Evaluate aspects of multi-tenant agents, including data ownership, monitoring, and testing

About this content series

This guide is part of a set of publications that provide architectural blueprints and technical guidance for building AI-driven software agents on AWS. The AWS Prescriptive Guidance series includes the following guides:

For more information about this content series, see Agentic AI.