Accelerate AI network performance by 1.6x over off-the-shelf (OTS) Ethernet.
Introduction
Train and deploy massive-scale AI with the NVIDIA Spectrum-X™ Ethernet networking platform. Powered by the tight coupling of the NVIDIA Spectrum-X Ethernet switch and the NVIDIA Spectrum-X Ethernet SuperNIC™, the platform delivers the highest performance for AI—connecting AI compute fabrics within the data center, scaling across multiple AI data centers with Spectrum-XGS Ethernet, and supporting innovative co-packaged optical switching for enhanced power efficiency and AI workload resiliency.
Benefits
Spectrum-X Ethernet is a revolutionary solution for building multi-tenant, hyperscale AI clouds. Using Spectrum-X Ethernet, organizations can significantly improve the performance and power efficiency of AI clouds and gain higher predictability and consistency, resulting in faster time to market and a greater competitive edge.
NVIDIA Spectrum-X Ethernet enhances network performance by 1.6x, accelerating the processing, analysis, and execution of AI workloads and, in turn, the development and deployment of AI solutions.
Powered by NVIDIA networking innovations, Spectrum-X Ethernet is fully standards-based Ethernet with support for open Ethernet stacks (SONiC) at cloud scale.
Spectrum-X Ethernet is tuned and validated across the full stack of NVIDIA hardware and software, creating an unmatched Ethernet solution for AI clouds. NVIDIA DSX Air integrates simulation of Spectrum-X Ethernet with the full-stack AI factory, including best-of-breed components from NVIDIA and ecosystem partners.
NVIDIA Spectrum-XGS Ethernet is built for scaling across multiple disparate data centers—located in different buildings or separated by hundreds of kilometers—allowing them to function as a single unified AI super-factory. Spectrum-XGS Ethernet uses a topology-aware congestion control algorithm, precise latency management, and end-to-end telemetry to deliver 1.9x higher NCCL performance in cross-data center environments.
Spectrum-X Ethernet Photonics reduces power consumption, increases reliability, and enhances AI productivity by situating the optics on the same package as the switch ASIC. Spectrum-X Ethernet Photonics enables 5x better network power efficiency, higher network resiliency, and 5x longer sustained AI application runtime compared with traditional pluggable transceiver-based networks.
Spectrum-X multiplane enables Ethernet to scale from thousands to hundreds of thousands of GPUs using a flat, two-tier topology. By splitting each GPU’s SuperNIC across two or more independent network planes, it overcomes single-plane limits, improves performance and resiliency, and scales Spectrum-X Ethernet networks up to 128K GPUs in two tiers—64x more than single-plane networks.
Spectrum-X Ethernet is fully integrated into the NVIDIA MGX™ ETL rack-scale architecture, delivering high-performance Ethernet networking for ultra-dense compute racks and expanding MGX liquid-cooling and reliability innovations to a wider variety of compute options. The power-efficient, copper-based cable cartridge connects liquid-cooled Spectrum-X Ethernet switch trays to up to 256 GPUs in a single rack, while front-panel optical connectivity enables scale-out to larger GPU domains.
Products
The NVIDIA Spectrum-X Ethernet switches are purpose-built to accelerate hyperscale generative AI fabrics. Spectrum-X Ethernet switches deliver high effective bandwidth and performance isolation for AI factories, scaling infrastructure to hundreds of thousands of GPUs and enabling the training and deployment of the world’s largest AI models.
The NVIDIA Spectrum-X Ethernet SuperNICs are novel classes of network accelerators, purpose-built for supercharging hyperscale AI workloads. Designed for network-intensive, massively parallel computations, NVIDIA SuperNICs provide high-bandwidth RDMA over Converged Ethernet (RoCE) network connectivity between GPU servers, optimizing peak AI workload efficiency.
Applications
Partners
Resources
The NVIDIA Spectrum-X Ethernet platform is the world’s first end-to-end, AI-optimized Ethernet platform for multi-tenant generative AI factories. It combines purpose-built Ethernet switches and SuperNICs to deliver high effective bandwidth, low latency, and strong performance isolation for hyperscale AI infrastructure—all built on standards-based Ethernet.
NVIDIA Spectrum-X Ethernet is designed for cloud service providers and large enterprises running multi-tenant AI workloads at hyperscale. It supports environments ranging from large enterprise deployments to massive cloud AI factories with hundreds of thousands of GPU connections.
Spectrum-X Ethernet uses advanced telemetry-based congestion control to provide noise isolation between tenants. Built-in performance isolation ensures each tenant’s AI workloads run predictably and consistently, improving service quality across simultaneous AI jobs.
Adaptive routing is a feature where the Spectrum-X Ethernet switch and SuperNIC work in tight coordination to dynamically route traffic, enabling the highest effective bandwidth and network resiliency for AI fabrics. It is specifically targeted at lossless networking to prevent performance degradation at scale.
Spectrum-X Ethernet scales to hundreds of thousands of GPU connections in efficient two-tier leaf/spine topologies. With Spectrum-X Multiplane technologies, networks can scale up to 128,000 GPUs in two tiers—64x more than single-plane networks—by splitting each GPU’s SuperNIC traffic across two or more independent network planes.
Spectrum-XGS Ethernet is an extension of the Spectrum-X platform designed for “gigascale” AI, enabling multiple distributed data centers—potentially separated by hundreds of kilometers—to function as a single AI super-factory. It introduces a modified congestion control algorithm that accounts for inter-facility distance, and it accelerates multi-site NCCL collectives by 1.9x compared to standard approaches.
The newest generation (for NVIDIA Vera Rubin AI factories) is based on the Spectrum-6 ASIC, offering 102.4 Tb/s per switch chip with 200 G SerDes—double the bandwidth per lane versus the prior generation. The SN6600 offers 128 ports of 800 G OSFP connectivity, while the SN6800 packs 512 ports of 800 G in a 5U form factor.
The Spectrum-X Ethernet Photonics switches use silicon photonics (co-packaged optics) technology to deliver 10x greater mean-time-between-interruptions (MTBI), 5x longer uptime, and 5x better power efficiency compared to traditional pluggable transceiver-based switches. They use the ultra-dense MMC-16 optical fiber form factor for efficient switch footprint usage.
The Spectrum-X Ethernet platform supports three SuperNICs across generations: the BlueField™-3 (for NVIDIA Hopper-era systems, optimized for RDMA/RoCE and multi-tenant isolation), the ConnectX™-8 (800 Gb/s total throughput via 2×400 G, PCIe Gen6, for NVIDIA Blackwell systems), and the ConnectX-9 (1,600 Gb/s per GPU via 4×200 G SerDes, PCIe Gen6, for NVIDIA Vera Rubin NVL72 systems). All SuperNICs offload collective communications and provide telemetry for adaptive routing.
NVIDIA NetQ™ provides flow-level visibility, tracing performance from the GPU to the SuperNIC, and mapping per-hop behavior across switch ports and RoCE queues. For deployment, NVIDIA DSX Air simulates a full AI factory ecosystem, allowing customers to validate hardware and partner offerings to accelerate time-to-first-token and ensure day-one performance at scale.
Next Steps