Conference Workshops & Training

The CUDA computing platform enables the acceleration of CPU-only applications to run on the world’s fastest massively parallel GPUs. Experience C/C++ application acceleration by:

- Accelerating CPU-only applications to run their latent parallelism on GPUs
- Utilizing essential CUDA memory management techniques to optimize accelerated applications
- Exposing accelerated application potential for concurrency and exploiting it with CUDA streams
- Leveraging Nsight Systems to guide and check your work

Upon completion, you’ll be able to accelerate and optimize existing C/C++ CPU-only applications using the most essential CUDA techniques and Nsight Systems. You’ll understand an iterative style of CUDA development that will allow you to ship accelerated applications fast.

RAPIDS is a collection of data science libraries that allows end-to-end GPU acceleration for data science workflows. In this training, you'll:

- Use cuDF and Dask to ingest and manipulate massive datasets directly on the GPU
- Apply a wide variety of GPU-accelerated machine learning algorithms, including XGBoost, cuGRAPH, and cuML, to perform data analysis at massive scale
- Perform multiple analysis tasks on massive datasets in an effort to stave off a simulated epidemic outbreak affecting the UK

Upon completion, you'll be able to load, manipulate, and analyze data orders of magnitude faster than before, enabling more iteration cycles and drastically improving productivity.

You’ll learn how to use Transformer-based natural language processing models for text classification tasks, such as categorizing documents. You will also learn how to leverage Transformer-based models for named-entity recognition (NER) tasks and how to analyze various model features, constraints, and characteristics to determine which model is best suited for a particular use case based on metrics, domain specificity, and available resources.

By participating in this workshop, you’ll be able to:

- Understand how text embeddings have rapidly evolved in NLP tasks such as Word2Vec, recurrent neural network (RNN)-based embeddings, and Transformers
- See how Transformer architecture features, especially self-attention, are used to create language models without RNNs
- Use self-supervision to improve the Transformer architecture in BERT, Megatron, and other variants for superior NLP results
- Leverage pre-trained, modern NLP models to solve multiple tasks such as text classification, NER, and question answering
- Manage inference challenges and deploy refined models for live applications

The amount of information moving through our world’s telecommunications infrastructure makes it one of the most complex and dynamic systems that humanity has ever built. In this workshop, you’ll implement multiple AI-based solutions to solve an important telecommunications problem: identifying network intrusions.

In this workshop, you’ll:

- Implement three different anomaly detection techniques: accelerated XGBoost, deep learning-based autoencoders, and generative adversarial networks (GANs)
- Build and compare supervised learning with unsupervised learning-based solutions
- Discuss other use cases within your industry that could benefit from modern computing approaches

Upon completion, you'll be able to detect anomalies within large datasets using supervised and unsupervised machine learning.

Modern deep learning challenges leverage increasingly larger datasets and more complex models. As a result, significant computational power is required to train models effectively and efficiently. In this course, you will learn how to scale deep learning training to multiple GPUs. Using multiple GPUs for deep learning can significantly shorten the time required to train lots of data, making solving complex problems with deep learning feasible.

This course will teach you how to use multiple GPUs to train neural networks. You'll learn:

- Approaches to multi-GPU training
- Algorithmic and engineering challenges to large-scale training
- Key techniques used to overcome the challenges mentioned above

Upon completion, you'll be able to effectively parallelize training of deep neural networks using Horovod.

Learn how to design, train, and deploy deep neural networks for autonomous vehicles using the DRIVE development platform.

You'll learn how to:

- Work with CUDA code, memory management, and GPU acceleration on the DRIVE AGX
- Train a semantic segmentation neural network
- Optimize, validate, and deploy a trained neural network using TensorRT

Upon completion, you'll be able to create and optimize perception components for autonomous vehicles using NVIDIA DRIVE.

Writing CUDA C++ applications that efficiently and correctly utilize all available GPUs on a node drastically improves performance over single-GPU code, and makes the most cost-effective use out of compute nodes with multiple GPUs. In this workshop you will learn to utilize multiple GPUs on a single node by:

- Learning how to launch kernels on multiple GPUs, each working on a subsection of the required work
- Learning how to use concurrent CUDA Streams to overlap memory copy with computation on multiple GPUs

Upon completion, you will be able to build robust and efficient CUDA C++ applications that can leverage all available GPUs on a single node.

Discover how deep learning works through hands-on exercises in computer vision and natural language processing. You’ll train deep learning models from scratch, learning tools and tricks to achieve highly accurate results. You’ll also learn to leverage freely available, state-of-the-art pre-trained models to save time and get your deep learning application up and running quickly.

By participating in this is workshop, you’ll:
> Learn the fundamental techniques and tools required to train a deep learning model
> Gain experience with common deep learning data types and model architectures
> Enhance datasets through data augmentation to improve model accuracy
> Leverage transfer learning between models to achieve efficient results with less data and computation
> Build confidence to take on your own project with a modern deep learning framework

Learn how to identify anomalies and failures in time-series data, estimate the remaining useful life of the corresponding parts, and use this information to map anomalies to failure conditions.

You'll learn how to:

> Leverage predictive maintenance to manage failures and avoid costly unplanned downtimes
> Identify key challenges around identifying anomalies that can lead to costly breakdowns
> Use time-series data to predict outcomes using machine learning classification models with XGBoost
> Apply predictive maintenance procedures by using a long short-term memory ( LSTM)-based model to predict device failure
> Experiment with autoencoders to detect anomalies by using the time-series sequences from the previous steps

Upon completion, you’ll understand how to use AI to predict the condition of equipment and estimate when maintenance should be performed.

The CUDA computing platform enables the acceleration of CPU-only applications to run on the world’s fastest massively parallel GPUs. Experience C/C++ application acceleration by:

> Accelerating CPU-only applications to run their latent parallelism on GPUs
> Utilizing essential CUDA memory management techniques to optimize accelerated applications
> Exposing accelerated application potential for concurrency and exploiting it with CUDA streams
> Leveraging Nsight Systems to guide and check your work

Upon completion, you’ll be able to accelerate and optimize existing C/C++ CPU-only applications using the most essential CUDA techniques and Nsight Systems. You’ll understand an iterative style of CUDA development that will allow you to ship accelerated applications fast.

You’ll learn how to use Transformer-based natural language processing models for text classification tasks, such as categorizing documents. You will also learn how to leverage Transformer-based models for named-entity recognition (NER) tasks and how to analyze various model features, constraints, and characteristics to determine which model is best suited for a particular use case based on metrics, domain specificity, and available resources.

By participating in this workshop, you’ll be able to:
> Understand how text embeddings have rapidly evolved in NLP tasks such as Word2Vec, recurrent neural network (RNN)-based embeddings, and Transformers
> See how Transformer architecture features, especially self-attention, are used to create language models without RNNs
> Use self-supervision to improve the Transformer architecture in BERT, Megatron, and other variants for superior NLP results
> Leverage pre-trained, modern NLP models to solve multiple tasks such as text classification, NER, and question answering
> Manage inference challenges and deploy refined models for live applications

Learn how GPUs change the game for Data Engineering on the hardware level and how to optimize pipelines with CUDA Python Libraries.

Practice GPU based Data Engineering by:

> Surveying different Data Formats and their strengths and weaknesses
> Using statistics to get a "feel" for the data and visualizing it in a dashboard
> Scaling an ETL pipeline to multiple GPUs using NVTabular

Upon completion, learners will be able to make appropriate hardware and software choices to optimize the speed of their data pipelines.

Writing CUDA C++ applications that efficiently and correctly utilize all available GPUs on a node drastically improves performance over single-GPU code, and makes the most cost-effective use out of compute nodes with multiple GPUs. In this workshop you will learn to utilize multiple GPUs on a single node by:

- Learning how to launch kernels on multiple GPUs, each working on a subsection of the required work
- Learning how to use concurrent CUDA Streams to overlap memory copy with computation on multiple GPUs

Upon completion, you will be able to build robust and efficient CUDA C++ applications that can leverage all available GPUs on a single node.

RAPIDS is a collection of data science libraries that allows end-to-end GPU acceleration for data science workflows. In this training, you'll:

> Use cuDF and Dask to ingest and manipulate massive datasets directly on the GPU
> Apply a wide variety of GPU-accelerated machine learning algorithms, including XGBoost, cuGRAPH, and cuML, to perform data analysis at massive scale
> Perform multiple analysis tasks on massive datasets in an effort to stave off a simulated epidemic outbreak affecting the UK

Upon completion, you'll be able to load, manipulate, and analyze data orders of magnitude faster than before, enabling more iteration cycles and drastically improving productivity.

Deep learning-based recommender systems are the secret ingredient behind personalized online experiences and powerful decision support tools in retail, entertainment, healthcare, finance, and other industries. This workshop covers the fundamental tools and techniques for building highly effective recommender systems, as well as how to deploy GPU-accelerated solutions for real-time recommendations.

By participating in this is workshop, you’ll learn how to:
> Build a content-based recommender system using the open-source cuDF library and Apache Arrow
> Construct a collaborative filtering recommender system using alternating least squares (ALS) and CuPy
> Design a wide and deep neural network using TensorFlow 2 to create a hybrid recommender system
> Optimize performance for both training and inference using large, sparse datasets
> Deploy a recommender model as a high-performance web service

You’ll learn how to use Transformer-based natural language processing models for text classification tasks, such as categorizing documents. You will also learn how to leverage Transformer-based models for named-entity recognition (NER) tasks and how to analyze various model features, constraints, and characteristics to determine which model is best suited for a particular use case based on metrics, domain specificity, and available resources.

By participating in this workshop, you’ll be able to:
> Understand how text embeddings have rapidly evolved in NLP tasks such as Word2Vec, recurrent neural network (RNN)-based embeddings, and Transformers
> See how Transformer architecture features, especially self-attention, are used to create language models without RNNs
> Use self-supervision to improve the Transformer architecture in BERT, Megatron, and other variants for superior NLP results
> Leverage pre-trained, modern NLP models to solve multiple tasks such as text classification, NER, and question answering
> Manage inference challenges and deploy refined models for live applications

Deep learning-based recommender systems are the secret ingredient behind personalized online experiences and powerful decision support tools in retail, entertainment, healthcare, finance, and other industries. This workshop covers the fundamental tools and techniques for building highly effective recommender systems, as well as how to deploy GPU-accelerated solutions for real-time recommendations.

By participating in this is workshop, you’ll learn how to:
> Build a content-based recommender system using the open-source cuDF library and Apache Arrow
> Construct a collaborative filtering recommender system using alternating least squares (ALS) and CuPy
> Design a wide and deep neural network using TensorFlow 2 to create a hybrid recommender system
> Optimize performance for both training and inference using large, sparse datasets
> Deploy a recommender model as a high-performance web service

With the increase in traffic cameras, growing prospect of autonomous vehicles, and promising outlook of smart cities, there's a rise in demand for faster and more efficient object detection and tracking models. This involves identification, tracking, segmentation and prediction of different types of objects within video frames.

In this workshop, you’ll learn how to:

- Efficiently process and prepare video feeds using hardware accelerated decoding methods
- Train and evaluate deep learning models and leverage ""transfer learning"" techniques to elevate efficiency and accuracy of these models and mitigate data sparsity issues
- Explore the strategies and trade-offs involved in developing high-quality neural network models to track moving objects in large-scale video datasets
- Optimize and deploy video analytics inference engines by acquiring the DeepStream SDK

Upon completion, you'll be able to design, train, test and deploy building blocks of a hardware-accelerated traffic management system based on parking lot camera feeds.

Learn how to identify anomalies and failures in time-series data, estimate the remaining useful life of the corresponding parts, and use this information to map anomalies to failure conditions.

You'll learn how to:

> Leverage predictive maintenance to manage failures and avoid costly unplanned downtimes
> Identify key challenges around identifying anomalies that can lead to costly breakdowns
> Use time-series data to predict outcomes using machine learning classification models with XGBoost
> Apply predictive maintenance procedures by using a long short-term memory ( LSTM)-based model to predict device failure
> Experiment with autoencoders to detect anomalies by using the time-series sequences from the previous steps

Upon completion, you’ll understand how to use AI to predict the condition of equipment and estimate when maintenance should be performed.

Modern deep learning challenges leverage increasingly larger datasets and more complex models. As a result, significant computational power is required to train models effectively and efficiently. In this course, you will learn how to scale deep learning training to multiple GPUs. Using multiple GPUs for deep learning can significantly shorten the time required to train lots of data, making solving complex problems with deep learning feasible.

This course will teach you how to use multiple GPUs to train neural networks. You'll learn:

- Approaches to multi-GPU training
- Algorithmic and engineering challenges to large-scale training
- Key techniques used to overcome the challenges mentioned above

Upon completion, you'll be able to effectively parallelize training of deep neural networks using Horovod.

You’ll learn how to use Transformer-based natural language processing models for text classification tasks, such as categorizing documents. You will also learn how to leverage Transformer-based models for named-entity recognition (NER) tasks and how to analyze various model features, constraints, and characteristics to determine which model is best suited for a particular use case based on metrics, domain specificity, and available resources.

By participating in this workshop, you’ll be able to:
> Understand how text embeddings have rapidly evolved in NLP tasks such as Word2Vec, recurrent neural network (RNN)-based embeddings, and Transformers
> See how Transformer architecture features, especially self-attention, are used to create language models without RNNs
> Use self-supervision to improve the Transformer architecture in BERT, Megatron, and other variants for superior NLP results
> Leverage pre-trained, modern NLP models to solve multiple tasks such as text classification, NER, and question answering
> Manage inference challenges and deploy refined models for live applications

Modern deep learning challenges leverage increasingly larger datasets and more complex models. As a result, significant computational power is required to train models effectively and efficiently. In this course, you will learn how to scale deep learning training to multiple GPUs. Using multiple GPUs for deep learning can significantly shorten the time required to train lots of data, making solving complex problems with deep learning feasible.

This course will teach you how to use multiple GPUs to train neural networks. You'll learn:

> Approaches to multi-GPU training
> Algorithmic and engineering challenges to large-scale training
> Key techniques used to overcome the challenges mentioned above

Upon completion, you'll be able to effectively parallelize training of deep neural networks using Horovod.

Discover how deep learning works through hands-on exercises in computer vision and natural language processing. You’ll train deep learning models from scratch, learning tools and tricks to achieve highly accurate results. You’ll also learn to leverage freely available, state-of-the-art pre-trained models to save time and get your deep learning application up and running quickly.

By participating in this is workshop, you’ll:
> Learn the fundamental techniques and tools required to train a deep learning model
> Gain experience with common deep learning data types and model architectures
> Enhance datasets through data augmentation to improve model accuracy
> Leverage transfer learning between models to achieve efficient results with less data and computation
> Build confidence to take on your own project with a modern deep learning framework

You’ll learn how to use Transformer-based natural language processing models for text classification tasks, such as categorizing documents. You will also learn how to leverage Transformer-based models for named-entity recognition (NER) tasks and how to analyze various model features, constraints, and characteristics to determine which model is best suited for a particular use case based on metrics, domain specificity, and available resources.

By participating in this workshop, you’ll be able to:
> Understand how text embeddings have rapidly evolved in NLP tasks such as Word2Vec, recurrent neural network (RNN)-based embeddings, and Transformers
> See how Transformer architecture features, especially self-attention, are used to create language models without RNNs
> Use self-supervision to improve the Transformer architecture in BERT, Megatron, and other variants for superior NLP results
> Leverage pre-trained, modern NLP models to solve multiple tasks such as text classification, NER, and question answering
> Manage inference challenges and deploy refined models for live applications

In this workshop you will learn the tools and techniques required to write CUDA C++ applications that can scale efficiently to clusters of NVIDIA GPUs. You will do this by working on code from several CUDA C++ applications in an interactive cloud environment backed by several NVIDIA GPUs. You will gain exposure to a handful of multi-GPU programming methods including CUDA-Aware MPI before proceeding to the main focus of this course, NVSHMEM.

By participating in the workshop you will:

> Learn several methods for writing correct multi-GPU CUDA C++ applications.
> Use a variety of multi-GPU communication patterns and learn to reason about their tradeoffs.
> Write portable, scalable CUDA code with the Single-Process Multiple-Data (SPMD) paradigm using CUDA-aware MPI and NVSHMEM.
> Improve multi-GPU SPMD code with NVSHMEM’s symmetric memory model, and its ability to perform GPU-initiated data transfers.
> Get practice with common multi-GPU coding paradigms like domain decomposition and halo exchanges.
> Receive guidance for how to reason about scaling considerations for a variety of GPU cluster configurations.