QuestionQ49

VerifiedAI Infrastructure Components and Architecture

A company is constructing a network fabric for an AI training cluster that will train large language models. The cluster contains 256 GPUs spread across 32 servers. Security requirements require isolation among separate training projects while permitting shared access to a central storage system. Which approach delivers the necessary security isolation while preserving optimal GPU-to-GPU communication performance?

Explanation

Separate VXLAN VNIs provide logical isolation for each training project on the same high-performance fabric. Group Policy Option (GPO) extends VXLAN with security-group tags and supports granular, group-based policy enforcement, so access to the central storage system can be explicitly permitted without removing project isolation or inserting router-based controls into GPU east-west traffic. Cisco documents GPO as a VXLAN extension for microsegmentation and granular traffic control using security-group policies.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!