The NVIDIA EGX Platform for Edge Computing

Enterprises are now operating at the edge. On factory floors. In stores. On city streets. In urgent care facilities. At the edge, data flows from billions of IoT sensors to be processed by edge servers, driving real-time decisions where they’re needed. All of this is possible—smart retail, healthcare, manufacturing, transportation, and cities—with the NVIDIA EGX platform, which brings the power of accelerated AI to the edge.

Learn More

Bringing Real-Time AI to the Edge

The NVIDIA EGX platform delivers the power of accelerated AI computing to the edge with an easy-to-deploy cloud native software stack, a range of validated servers and devices, and a vast ecosystem of partners who offer EGX through their products and services.

Runs AI Containers

The NGC registry features an extensive range of GPU-accelerated software for EGX, including Helm charts for deployment on Kubernetes. NGC containers cover the top AI and data science software, tuned, tested, and optimized by NVIDIA. The registry also gives users access to third-party domain-specific, pre-trained models and Kubernetes-ready Helm charts that make it easy to deploy powerful software or build customized solutions.

Cloud Native, Edge-First

NVIDIA EGX is a cloud native, edge-first, and scalable software stack that enables IT to quickly and easily provision GPU servers. A primary component of EGX is the NVIDIA GPU Operator, which standardizes and automates the deployment of all the necessary components for provisioning GPU-enabled Kubernetes clusters.

EGX-Ready Servers

The EGX hardware portfolio starts with the tiny NVIDIA® Jetson Nano™, which in a few watts can provide one-half trillion operations per second (TOPS) of processing for tasks such as image recognition. And it scales all the way to a full rack of NVIDIA T4 servers, delivering more than 10,000 TOPS to serve hundreds of users with real-time speech recognition and other complex AI experiences.

AI Scalability from Edge to Data Center

AI Scalability from Edge to Data Center

The NVIDIA EGX platform includes a scalable range of NGC-Ready for Edge validated servers—from the Jetson Nano handling traffic cameras in a smart city, to a single edge server with NVIDIA GPUs installed in the back room of a retail store, to an entire fleet of servers comprising a micro data center for telecommunications operations. Whichever form factor, the NVIDIA EGX stack is compatible across the board, allowing businesses to scale edge operations quickly and efficiently, from cameras and devices to a remote large-scale data center.

IoT Revolution With AI and 5G

Accelerating the IoT Revolution with AI and 5G

5G is ushering in a new era of wireless communications that delivers 10X lower latency and 1000X the bandwidth. It also introduces the concept of network slicing, which will allow telecommunications companies (telcos) to dynamically offer unique services to customers. As telcos transition to 5G, they’ll look to operate a range of software-defined applications at the telco edge—from AI and augmented reality to virtual reality and gaming. With NVIDIA EGX and the new NVIDIA Aerial SDK, GPU-accelerated and software-defined virtual radio access networks (vRANs) is arriving sooner than you think.

NVIDIA EGX Stack

IT Simplicity for Edge Deployment

With the NVIDIA EGX Stack, traditional IT issues of installing software on remote systems disappear. Using Helm charts, containers, and continuous integration and continuous delivery (CI/CD), organizations can now deploy updated AI containers effortlessly in minutes.

The Kubernetes-based NVIDIA GPU Operator solves the problem of needing unique operating system (OS) images between GPU and CPU nodes; instead, the GPU Operator bundles everything you need to support a Tesla GPU — the driver, container runtime, device plug-in, and monitoring with deployment by a Helm chart. Now, a single gold master image covers both CPU and GPU nodes.

Hybrid Cloud Management

Compatible with Kubernetes Management Platforms

The ability to deploy, scale, and manage a production-grade, enterprise-class Kubernetes cluster is critical. The EGX stack architecture is supported by leading hybrid-cloud platform partners: Canonical, Cisco Container Platform (CCP), Microsoft Azure, Nutanix, Red Hat, and VMware. Their support for the GPU Operator ensures these clusters are configured for GPU workloads and that they perform in an optimal, consistent fashion.

Edge Computing Across Industries

The NVIDIA EGX platform provides a single, unifying foundation for industry-leading edge AI applications and frameworks.

Retail

Retail

Manufacturing

Manufacturing

Telecom

Telecom

Smart Cities

Smart Cities

At Seagate, we have deployed an intelligent edge GPU-based vision solution in our manufacturing plants to inspect the quality of our hard disk read-and-write heads. The NVIDIA EGX platform dramatically accelerates inference at the edge, allowing us to see subtle defects that human operators haven’t been able to see in the past. We expect to realize up to a 10 percent improvement in manufacturing throughput and up to 300 percent ROI from improved efficiency and better quality.

— Bruce King, Senior Principal Data Scientist, Seagate Technology

AI is fundamental to achieving precision health and must be pervasively available from the cloud to the edge and directly on medical devices. NVIDIA’s EGX enables GE Healthcare to deliver rapid [magnetic resonance (MR)] acquisition times, improves image quality, and reduces variability by embedding NVIDIA T4 GPUs directly into our medical devices—all to further our goal of improving patient outcomes. Real-time, critical-care use cases demand AI at the edge. This is why we created our Edison intelligence offering and partnered with NVIDIA to bring AI into our medical devices and Edison edge appliances—and why we are working with ACR AI-LAB to democratize AI.

— Jason Polzin, PhD, General Manager of MR Applications at GE Healthcare

Red Hat is committed to providing a consistent experience for any workload, footprint, and location, from the hybrid cloud to the edge. By combining Red Hat OpenShift and NVIDIA EGX-enabled platforms, customers can better optimize their distributed operations with a consistent, high-performance, container-centric environment.

— Chris Wright, Chief Technology Officer, Red Hat

Avitas is working to revolutionize asset integrity management through our innovative digital inspection and prediction platform. Our unique approach combines advanced analytics with autonomous inspection techniques helping our customers to provide safer, cleaner and more efficient energy solutions. NVIDIA is an important partner in helping to scale our edge capabilities with the EGX Platform.

— Jason Roe, CEO – Avitas Systems, a Baker Hughes Venture

Mellanox SmartNICs and switches provide the ideal [input/output (I/O)] connectivity for data access that scale from the edge to hyperscale data centers. The combination of high-performance, low-latency, and accelerated networking provides a new infrastructure tier of computing that is critical to efficiently access and supply the data needed to fuel the next generation of advanced AI solutions on edge platforms such as NVIDIA EGX.

— Michael Kagan, Chief Technology Officer, Mellanox Technologies

Enterprise-Grade Software Stack for EGX

Enterprise-Grade Software Stack for EGX

NVIDIA EGX stack is an optimized software stack that includes NVIDIA drivers, a Kubernetes plug-in, a container runtime, and containerized AI frameworks and applications, including NVIDIA TensorRT™, TensorRT Inference Server, and DeepStream. The NVIDIA EGX stack is optimized for NGC-Ready for Edge servers, and Helm charts for installation will be available on the NVIDIA NGC registry.

EGX Partners

  • Edge Server Manufacturers
  • Hybrid Cloud Platform Partners
Acer
Advantech
ASRock Rack
Asus
Atos
Cisco
Dell EMC
Fujitsu
Gigabyte
Hewlett Packard Enterprise
Inspur
Ineventec
Lenovo
Mitac
Quanta Cloud Technology
Supermicro
Tyan
wiwynn
Canonical
Cisco
Microsoft Azure
Nutanix
Red Hat
VMware

NVIDIA EGX in Action

Sign up to learn more about the NVIDIA EGX edge computing platform.

Subscribe

Get The Latest News in Edge Computing

Produtos
Tecnologias
Recursos