← Perspectives

04

AI Governance Across the Architecture

AI governance is often discussed primarily at the organizational level through policies, committees, principles, compliance processes, and acceptable-use rules. These mechanisms remain important, but they are insufficient for autonomous systems. As AI becomes more agentic, AI governance must extend through the architecture itself, connecting organizational intent to the technical mechanisms through which models perceive information, exercise authority, and take action.

Different layers create different governance problems. At the model layer, governance concerns capabilities, behaviour, evaluation, and model-level safeguards. At the data and memory layers, it concerns provenance, persistence, access, contamination, and the distinction between trusted and untrusted information. At the agent layer, governance must address goals, planning, delegation, coordination, and the conditions under which an AI system may act independently. At the tool and runtime layers, it becomes a question of identity, credentials, permissions, authorization, monitoring, containment, and recovery. Above these technical layers remains the organizational question of who defines the boundaries, who retains responsibility, and which decisions must remain under human authority.

These layers cannot be governed independently because failures propagate across them. A policy limiting an agent's authority has little practical significance if its technical permissions exceed that authority. A well-behaved model can still act dangerously if its memory has been corrupted. Strong monitoring cannot compensate for unclear decision rights. Effective AI governance therefore requires a coherent chain from organizational objectives to machine behaviour, with controls at each layer ensuring that the authority exercised by the system remains consistent with the authority the organization intended to grant.

In practice

The emerging opportunity is a governance stack that mirrors the architecture of agentic systems themselves. Rather than relying on a single policy layer, organizations will need interoperable controls across models, memory, identity, tools, runtime, and human authorization, creating room for both horizontal governance platforms and highly specialized infrastructure at each layer.