NVIDIA Spectrum-X Ethernet Networking Platform

Accelerate AI network performance by 1.6x over off-the-shelf (OTS) Ethernet.

Introduction

The World’s First Ethernet Networking Platform for AI

Train and deploy massive-scale AI with the NVIDIA Spectrum-X™ Ethernet networking platform. Powered by the tight coupling of the NVIDIA Spectrum-X Ethernet switch and the NVIDIA Spectrum-X Ethernet SuperNIC™, the platform delivers the highest performance for AI—connecting AI compute fabrics within the data center, scaling across multiple AI data centers with Spectrum-XGS Ethernet, and supporting innovative co-packaged optical switching for enhanced power efficiency and AI workload resiliency.

NVIDIA Spectrum-X Multiplane Enables Massive AI Factory Scale on a Flatter, More Resilient Network​

Spectrum-X Multiplane enables Ethernet to scale to unprecedented size while avoiding the latency, jitter, and cost of adding another network tier.

NVIDIA Ethernet Networking Accelerates World’s Largest AI Supercomputer, Built by xAI

NVIDIA Spectrum-X Ethernet makes the colossal NVIDIA Hopper™ 100,000-GPU system possible.

Benefits

Powerful Performance in the AI Cloud

Spectrum-X Ethernet is a revolutionary solution for building multi-tenant, hyperscale AI clouds. Using Spectrum-X Ethernet, organizations can significantly improve the performance and power efficiency of AI clouds and gain higher predictability and consistency, resulting in faster time to market and a greater competitive edge.

Nearly Perfect Bandwidth at Scale

Extremely Low Latency

End-to-End Stack Optimization

Advanced RoCE Extensions for Scalable AI Communications

Deterministic Performance and Performance Isolation

Open Network Operating System: SONiC and NVIDIA® Cumulus®


Improved AI Cloud Performance

NVIDIA Spectrum-X Ethernet enhances network performance by 1.6x, accelerating the processing, analysis, and execution of AI workloads and, in turn, the development and deployment of AI solutions. 

Accelerated Ethernet for Hyperscale

Powered by NVIDIA networking innovations, Spectrum-X Ethernet is fully standards-based Ethernet with support for open Ethernet stacks (SONiC) at cloud scale.

Full-Stack Optimization and Simulation

Spectrum-X Ethernet is tuned and validated across the full stack of NVIDIA hardware and software, creating an unmatched Ethernet solution for AI clouds. NVIDIA DSX Air integrates simulation of Spectrum-X Ethernet with the full-stack AI factory, including best-of-breed components from NVIDIA and ecosystem partners.

Connect Data Centers for Gigascale AI

NVIDIA Spectrum-XGS Ethernet is built for scaling across multiple disparate data centers—located in different buildings or separated by hundreds of kilometers—allowing them to function as a single unified AI super-factory. Spectrum-XGS Ethernet uses a topology-aware congestion control algorithm, precise latency management, and end-to-end telemetry to deliver 1.9x higher NCCL performance in cross-data center environments.

NVIDIA Silicon Photonics

Spectrum-X Ethernet Photonics reduces power consumption, increases reliability, and enhances AI productivity by situating the optics on the same package as the switch ASIC. Spectrum-X Ethernet Photonics enables 5x better network power efficiency, higher network resiliency, and 5x longer sustained AI application runtime compared with traditional pluggable transceiver-based networks.

Spectrum-X Multiplane

Spectrum-X multiplane enables Ethernet to scale from thousands to hundreds of thousands of GPUs using a flat, two-tier topology. By splitting each GPU’s SuperNIC across two or more independent network planes, it overcomes single-plane limits, improves performance and resiliency, and scales Spectrum-X Ethernet networks up to 128K GPUs in two tiers—64x more than single-plane networks.

Rack-Scale Spectrum-X Ethernet

Spectrum-X Ethernet is fully integrated into the NVIDIA MGX™ ETL rack-scale architecture, delivering high-performance Ethernet networking for ultra-dense compute racks and expanding MGX liquid-cooling and reliability innovations to a wider variety of compute options. The power-efficient, copper-based cable cartridge connects liquid-cooled Spectrum-X Ethernet switch trays to up to 256 GPUs in a single rack, while front-panel optical connectivity enables scale-out to larger GPU domains.

Products

What’s Inside the Platform

NVIDIA Spectrum-X Ethernet Switches

The NVIDIA Spectrum-X Ethernet switches are purpose-built to accelerate hyperscale generative AI fabrics. Spectrum-X Ethernet switches deliver high effective bandwidth and performance isolation for AI factories, scaling infrastructure to hundreds of thousands of GPUs and enabling the training and deployment of the world’s largest AI models.

NVIDIA Spectrum-X Ethernet SuperNICs

The NVIDIA Spectrum-X Ethernet SuperNICs are novel classes of network accelerators, purpose-built for supercharging hyperscale AI workloads. Designed for network-intensive, massively parallel computations, NVIDIA SuperNICs provide high-bandwidth RDMA over Converged Ethernet (RoCE) network connectivity between GPU servers, optimizing peak AI workload efficiency.

Applications

How Spectrum-X Ethernet Technology Is Used

AI Compute Fabrics

Spectrum-X Ethernet is ideal for GPU-to-GPU communication, providing the high, effective bandwidth and performance isolation needed for AI training and distributed inference.

AI Storage

NVIDIA and the storage ecosystem are extending Spectrum-X Ethernet innovations to the data storage fabric, leading to faster time to AI and maximizing return on investment.

Partners

Who We’re Working With

Resources

Continue Exploring Spectrum-X Ethernet

Spectrum-X Ethernet Datasheet

Spectrum-X Ethernet Technical Whitepaper

Scale-In Networking Technical Blog

Spectrum-X Multiplane Technical Blog

Spectrum-X Ethernet Validated Solution Stack

Networking for AI Technical Whitepaper

Spectrum-XGS Ethernet Technical Blog

SuperNIC Technical Whitepaper

NVIDIA Spectrum-X Ethernet Platform FAQs

The NVIDIA Spectrum-X Ethernet platform is the world’s first end-to-end, AI-optimized Ethernet platform for multi-tenant generative AI factories. It combines purpose-built Ethernet switches and SuperNICs to deliver high effective bandwidth, low latency, and strong performance isolation for hyperscale AI infrastructure—all built on standards-based Ethernet.

NVIDIA Spectrum-X Ethernet is designed for cloud service providers and large enterprises running multi-tenant AI workloads at hyperscale. It supports environments ranging from large enterprise deployments to massive cloud AI factories with hundreds of thousands of GPU connections.

Spectrum-X Ethernet uses advanced telemetry-based congestion control to provide noise isolation between tenants. Built-in performance isolation ensures each tenant’s AI workloads run predictably and consistently, improving service quality across simultaneous AI jobs.

Adaptive routing is a feature where the Spectrum-X Ethernet switch and SuperNIC work in tight coordination to dynamically route traffic, enabling the highest effective bandwidth and network resiliency for AI fabrics. It is specifically targeted at lossless networking to prevent performance degradation at scale.

Spectrum-X Ethernet scales to hundreds of thousands of GPU connections in efficient two-tier leaf/spine topologies. With Spectrum-X Multiplane technologies, networks can scale up to 128,000 GPUs in two tiers—64x more than single-plane networks—by splitting each GPU’s SuperNIC traffic across two or more independent network planes.

Spectrum-XGS Ethernet is an extension of the Spectrum-X platform designed for “gigascale” AI, enabling multiple distributed data centers—potentially separated by hundreds of kilometers—to function as a single AI super-factory. It introduces a modified congestion control algorithm that accounts for inter-facility distance, and it accelerates multi-site NCCL collectives by 1.9x compared to standard approaches.

The newest generation (for NVIDIA Vera Rubin AI factories) is based on the Spectrum-6 ASIC, offering 102.4 Tb/s per switch chip with 200 G SerDes—double the bandwidth per lane versus the prior generation. The SN6600 offers 128 ports of 800 G OSFP connectivity, while the SN6800 packs 512 ports of 800 G in a 5U form factor.

The Spectrum-X Ethernet Photonics switches use silicon photonics (co-packaged optics) technology to deliver 10x greater mean-time-between-interruptions (MTBI), 5x longer uptime, and 5x better power efficiency compared to traditional pluggable transceiver-based switches. They use the ultra-dense MMC-16 optical fiber form factor for efficient switch footprint usage.

The Spectrum-X Ethernet platform supports three SuperNICs across generations: the BlueField™-3 (for NVIDIA Hopper-era systems, optimized for RDMA/RoCE and multi-tenant isolation), the ConnectX™-8 (800 Gb/s total throughput via 2×400 G, PCIe Gen6, for NVIDIA Blackwell systems), and the ConnectX-9 (1,600 Gb/s per GPU via 4×200 G SerDes, PCIe Gen6, for NVIDIA Vera Rubin NVL72 systems). All SuperNICs offload collective communications and provide telemetry for adaptive routing.

NVIDIA NetQ™ provides flow-level visibility, tracing performance from the GPU to the SuperNIC, and mapping per-hop behavior across switch ports and RoCE queues. For deployment, NVIDIA DSX Air simulates a full AI factory ecosystem, allowing customers to validate hardware and partner offerings to accelerate time-to-first-token and ensure day-one performance at scale.

Next Steps

Get a Free Trial of NVIDIA Networking Software

Simulate a fully automated network topology using NVIDIA DSX Air.

Discover Networking for the Era of AI

The network is ultimately responsible for AI performance, acting as the backbone of the data center to harness the power of generative AI.

Learn About the Spectrum-X Ethernet Platform

The Spectrum-X Ethernet platform is designed specifically to improve the performance and efficiency of Ethernet-based AI infrastructure.

Sign up to receive the latest news from NVIDIA.

Augtera is now a part of NVIDIA 

Augtera was acquired by NVIDIA Corporation of Santa Clara, CA in December 2024. It will become a part of NVIDIA Spectrum-X product portfolio.

Partners

Who We’re Working With