探索永不停歇

觀眾等級： 初學者技術

必備基礎能力： 瞭解基本程式設計概念
Python 例如函數、迴圈、字典和陣列。

進行電腦視覺和自然語言處理方面的實作練習，藉此瞭解深度學習的運作方式。您將會從零開始訓練深度學習模型、學習工具和技巧，追求高度準確的成果。也會學習如何運用免費提供的頂尖預先訓練模型，如此可以節省時間，並讓深度學習應用程式快速運作。

參加本實作坊可學會：
- 瞭解訓練深度學習模型所需的基本技術和工具
- 熟悉通用的深度學習資料類型和模型架構
- 透過資料增強來強化資料集以提升模型精準度
- 運用模型之間的遷移學習，以更少的資料和運算達成高效率的成果
- 使用現代的深度學習框架，更具信心地打造自己的專案

Audience Level: Intermediate Technical

Prerequisite(s):
> Familiarity with defensive cybersecurity themes
> Professional data science and/or data analysis experience
> Competency with the Python programming language
> Competency with the Linux command line

Session Abstract:
The NVIDIA Morpheus AI framework lets cybersecurity developers and practitioners harness the power of GPU computing to implement cybersecurity solutions that perform on a scale never before possible. With Morpheus, cybersecurity developers can create optimized AI pipelines for filtering, processing, and classifying large volumes of real-time data. Bringing a new level of information security to data centers, Morpheus enables dynamic protection, real-time telemetry, and adaptive defenses for detecting and remediating cybersecurity threats.

In this workshop you will get hands-on experience solving real-world cybersecurity challenges using the NVIDIA Morpheus AI framework. By the time you complete this workshop you will:

> Be able to build end-to-end Morpheus pipelines to process and analyze massive data streams using NVIDIA GPUs and AI.
> Be able to fine-tune Morpheus's out-of-the-box AI toolkit for your organization's specific needs.
> Understand the key components of the Morpheus framework, how they work together, and how to get started with them on your own.

Audience Level: Beginner Technical

Prerequisite(s): Basic C/C++ competency including familiarity with variable types, loops, conditional statements, functions, and array manipulations.

Session Abstract: The CUDA computing platform enables the acceleration of CPU-only applications to run on the world’s fastest massively parallel GPUs. Experience C/C++ application acceleration by:

> Accelerating CPU-only applications to run their latent parallelism on GPUs
> Utilizing essential CUDA memory management techniques to optimize accelerated applications
> Exposing accelerated application potential for concurrency and exploiting it with CUDA streams
> Leveraging Nsight Systems to guide and check your work

Upon completion, you’ll be able to accelerate and optimize existing C/C++ CPU-only applications using the most essential CUDA techniques and Nsight Systems. You’ll understand an iterative style of CUDA development that will allow you to ship accelerated applications fast.

Audience Level: Intermediate Technical

Prerequisite(s):
> Experience with Python coding and use of library functions and parameters
> Fundamental understanding of a deep learning framework such as TensorFlow, PyTorch, or Keras
> Basic understanding of neural networks

Session Abstract: You’ll learn how to use Transformer-based natural language processing models for text classification tasks, such as categorizing documents. You will also learn how to leverage Transformer-based models for named-entity recognition (NER) tasks and how to analyze various model features, constraints, and characteristics to determine which model is best suited for a particular use case based on metrics, domain specificity, and available resources.

By participating in this workshop, you’ll be able to:
> Understand how text embeddings have rapidly evolved in NLP tasks such as Word2Vec, recurrent neural network (RNN)-based embeddings, and Transformers
> See how Transformer architecture features, especially self-attention, are used to create language models without RNNs
> Use self-supervision to improve the Transformer architecture in BERT, Megatron, and other variants for superior NLP results
> Leverage pre-trained, modern NLP models to solve multiple tasks such as text classification, NER, and question answering
> Manage inference challenges and deploy refined models for live applications

Audience Level: Beginner Technical

Prerequisite(s): Experience with CNNs and Python

Session Abstract: The amount of information moving through our world’s telecommunications infrastructure makes it one of the most complex and dynamic systems that humanity has ever built. In this workshop, you’ll implement multiple AI-based solutions to solve an important telecommunications problem: identifying network intrusions.

In this workshop, you’ll:

> Implement three different anomaly detection techniques: accelerated XGBoost, deep learning-based autoencoders, and generative adversarial networks (GANs)
> Build and compare supervised learning with unsupervised learning-based solutions
> Discuss other use cases within your industry that could benefit from modern computing approaches

Upon completion, you'll be able to detect anomalies within large datasets using supervised and unsupervised machine learning.

Audience Level: Advanced Technical

Prerequisite(s): Intermediate experience writing CUDA C/C++ applications

Session Abstract: Building cluster scale accelerated computing applications that utilize multiple GPUs across multiple nodes requires a distinct set of skills. In this workshop you will learn how to do this by:

> Building efficient cluster-enabled CUDA C++ applications using CUDA-aware MPI and NVSHMEM
> Utilizing NCCL for highly optimized collective communications over multiple GPUs both within and across nodes
> Learning how to identify the best programming approach for your application and multi-node configuration

Upon completion, you will be able to write efficient CUDA C++ applications at cluster scale using a variety of programming models well-suited to many kinds of applications and multi-GPU multi-node configurations.

Audience Level: Beginner Technical

Prerequisite(s): An understanding of fundamental programming concepts in Python such as functions, loops, dictionaries, and arrays.

Session Abstract: Discover how deep learning works through hands-on exercises in computer vision and natural language processing. You’ll train deep learning models from scratch, learning tools and tricks to achieve highly accurate results. You’ll also learn to leverage freely available, state-of-the-art pre-trained models to save time and get your deep learning application up and running quickly.

By participating in this is workshop, you’ll:
> Learn the fundamental techniques and tools required to train a deep learning model
> Gain experience with common deep learning data types and model architectures
> Enhance datasets through data augmentation to improve model accuracy
> Leverage transfer learning between models to achieve efficient results with less data and computation
> Build confidence to take on your own project with a modern deep learning framework

Audience Level: Intermediate Technical

Prerequisite(s):
> Experience with Python coding and use of library functions and parameters
> Fundamental understanding of a deep learning framework such as TensorFlow, PyTorch, or
Keras
> Basic understanding of neural networks

Session Abstract: You’ll learn how to use Transformer-based natural language processing models for text classification tasks, such as categorizing documents. You will also learn how to leverage Transformer-based models for named-entity recognition (NER) tasks and how to analyze various model features, constraints, and characteristics to determine which model is best suited for a particular use case based on metrics, domain specificity, and available resources.

By participating in this workshop, you’ll be able to:
> Understand how text embeddings have rapidly evolved in NLP tasks such as Word2Vec, recurrent neural network (RNN)-based embeddings, and Transformers
> See how Transformer architecture features, especially self-attention, are used to create language models without RNNs
> Use self-supervision to improve the Transformer architecture in BERT, Megatron, and other variants for superior NLP results
> Leverage pre-trained, modern NLP models to solve multiple tasks such as text classification, NER, and question answering
> Manage inference challenges and deploy refined models for live applications

Audience Level: Beginner Technical

Prerequisite(s): Experience with Python, ideally including pandas and NumPy

Session Abstract: RAPIDS is a collection of data science libraries that allows end-to-end GPU acceleration for data science workflows. In this training, you'll:

> Use cuDF and Dask to ingest and manipulate massive datasets directly on the GPU
> Apply a wide variety of GPU-accelerated machine learning algorithms, including XGBoost, cuGRAPH, and cuML, to perform data analysis at massive scale
> Perform multiple analysis tasks on massive datasets in an effort to stave off a simulated epidemic outbreak affecting the UK

Upon completion, you'll be able to load, manipulate, and analyze data orders of magnitude faster than before, enabling more iteration cycles and drastically improving productivity.

Audience Level: Intermediate Technical

Prerequisite(s): Python programming experience, basic understanding of neural networks, and a fundamental understanding of a deep learning framework such as TensorFlow or PyTorch

Session Abstract: Learn how to quickly build and deploy production quality conversational AI applications with real-time transcription and natural language processing (NLP) capabilities.

Conversational AI pipelines are complex and expensive to develop from scratch. In this course, you'll learn to build a conversational AI service using the NVIDIA Riva framework. Riva provides a complete, GPU-accelerated software stack, making it easy for developers to quickly create, deploy, and run end-to-end, real-time conversational AI applications that can understand terminology unique to each company and its customers. The Riva framework includes pretrained conversational AI models, tools, and optimized services for speech, vision, and natural language understanding (NLU) tasks. With Riva, developers can create customized language-based AI services for intelligent virtual assistants, virtual customer service agents, real-time transcription, multi-user diarization,chatbots and much more.

In this course, you will integrate NVIDIA Riva automatic speech recognition (ASR) and named entity recognition (NER) models with a web-based application to produce transcriptions of audio inputs with highlighted relevant text. You'll then customize the NER model using NVIDIA TAO Toolkit to provide different targeted highlights for the application. Finally, you'll explore production-level deployment performance and scaling considerations of Riva services with Helm Charts and Kubernetes clusters.

You'll learn how to:

> Deploy and enable pretrained ASR and NER models on Riva for a Conversational AI Application
> Explore the Riva ASR service with audio examples
> Fine-tune and deploy a domain-specific NER model with TAO Toolkit
> Deploy a production-level conversational AI application with a Helm Chart for scaling in Kubernetes clusters

Upon completion, you’ll be able to build Conversational AI applications and deploy them as services.

Audience Level: Beginner Technical

Prerequisite(s): Experience with CNNs and Python

Session Abstract: The amount of information moving through our world’s telecommunications infrastructure makes it one of the most complex and dynamic systems that humanity has ever built. In this workshop, you’ll implement multiple AI-based solutions to solve an important telecommunications problem: identifying network intrusions.

In this workshop, you’ll:

> Implement three different anomaly detection techniques: accelerated XGBoost, deep learning-based autoencoders, and generative adversarial networks (GANs)
> Build and compare supervised learning with unsupervised learning-based solutions
> Discuss other use cases within your industry that could benefit from modern computing approaches

Upon completion, you'll be able to detect anomalies within large datasets using supervised and unsupervised machine learning.

Audience Level: Beginner Technical

Prerequisite(s): An understanding of fundamental programming concepts in Python such as functions, loops, dictionaries, and arrays.

Session Abstract: Discover how deep learning works through hands-on exercises in computer vision and natural language processing. You’ll train deep learning models from scratch, learning tools and tricks to achieve highly accurate results. You’ll also learn to leverage freely available, state-of-the-art pre-trained models to save time and get your deep learning application up and running quickly.

By participating in this is workshop, you’ll:
> Learn the fundamental techniques and tools required to train a deep learning model
> Gain experience with common deep learning data types and model architectures
> Enhance datasets through data augmentation to improve model accuracy
> Leverage transfer learning between models to achieve efficient results with less data and computation
> Build confidence to take on your own project with a modern deep learning framework

Audience Level: Intermediate Technical

Prerequisite(s):
>Experience with Python coding and use of library functions and parameters
>Fundamental understanding of a deep learning framework such as TensorFlow, PyTorch, or
Keras
>Basic understanding of neural networks

Session Abstract: You’ll learn how to use Transformer-based natural language processing models for text classification tasks, such as categorizing documents. You will also learn how to leverage Transformer-based models for named-entity recognition (NER) tasks and how to analyze various model features, constraints, and characteristics to determine which model is best suited for a particular use case based on metrics, domain specificity, and available resources.

By participating in this workshop, you’ll be able to:
> Understand how text embeddings have rapidly evolved in NLP tasks such as Word2Vec, recurrent neural network (RNN)-based embeddings, and Transformers
> See how Transformer architecture features, especially self-attention, are used to create language models without RNNs
> Use self-supervision to improve the Transformer architecture in BERT, Megatron, and other variants for superior NLP results
> Leverage pre-trained, modern NLP models to solve multiple tasks such as text classification, NER, and question answering
> Manage inference challenges and deploy refined models for live applications

Audience Level: Beginner Technical

Prerequisite(s): Experience with Python; basic understanding of data processing and deep learning.

Session Abstract: Learn how to design, train, test, and deploy building blocks of a hardware-accelerated industrial inspection pipeline.

Explore how to build a deep learning model to automate the verification of capacitors in NVIDIA's printed circuit board (PCB) using a real production dataset. This can lower the verification cost and increase the production throughput across a variety of manufacturing use cases. You'll learn how to:

> Extract meaningful insights from the provided dataset using Pandas DataFrame and NumPy library
> Apply transfer-learning to a deep learning classification model known as InceptionV3
> Fine-tune the deep learning model and set up evaluation metrics

Upon completion, you'll be able to design, train, test, and deploy building blocks of a hardware-accelerated industrial inspection pipeline.

Audience Level: Advanced Technical

Prerequisite(s):
> Good understanding of PyTorch, deep learning and data parallel training concepts
> Practice with multi-GPU training and natural language processing are useful, but optional

Session Abstract: Very large deep neural networks (DNNs), whether applied to natural language processing (e.g., GPT-3), computer vision (e.g., huge Vision Transformers), or speech AI (e.g., Wave2Vec 2) have certain properties that set them apart from their smaller counterparts. As DNNs become larger and are trained on progressively larger datasets, they can adapt to new tasks with just a handful of training examples, accelerating the route toward general artificial intelligence. Training models that contain tens to hundreds of billions of parameters on vast datasets isn’t trivial and requires a unique combination of AI, high-performance computing (HPC), and systems knowledge. The goal of this course is to demonstrate how to train the largest of neural networks and deploy them to production.

In this workshop, you’ll learn how to:

> Train neural networks across multiple servers
> Use techniques such as activation checkpointing, gradient accumulation, and various forms of model parallelism to overcome the challenges associated with large-model memory footprint
> Capture and understand training performance characteristics to optimize model architecture
> Deploy very large multi-GPU models to production using NVIDIA Triton™ Inference Server

Audience Level: Intermediate Technical

Prerequisite(s): Python programming experience, basic understanding of neural networks, and a fundamental understanding of a deep learning framework such as TensorFlow or PyTorch

Session Abstract: Learn how to quickly build and deploy production quality conversational AI applications with real-time transcription and natural language processing (NLP) capabilities.

Conversational AI pipelines are complex and expensive to develop from scratch. In this course, you'll learn to build a conversational AI service using the NVIDIA Riva framework. Riva provides a complete, GPU-accelerated software stack, making it easy for developers to quickly create, deploy, and run end-to-end, real-time conversational AI applications that can understand terminology unique to each company and its customers. The Riva framework includes pretrained conversational AI models, tools, and optimized services for speech, vision, and natural language understanding (NLU) tasks.  With Riva, developers can create customized language-based AI services for intelligent virtual assistants, virtual customer service agents, real-time transcription, multi-user diarization,chatbots and much more.

In this course, you will integrate NVIDIA Riva automatic speech recognition (ASR) and named entity recognition (NER) models with a web-based application to produce transcriptions of audio inputs with highlighted relevant text.  You'll then customize the NER model using  NVIDIA TAO Toolkit to provide different targeted highlights for the application. Finally, you'll explore production-level deployment performance and scaling considerations of Riva services with Helm Charts and Kubernetes clusters.

You'll learn how to:

> Deploy and enable pretrained ASR and NER models on Riva for a Conversational AI Application
> Explore the Riva ASR service with audio examples
> Fine-tune and deploy a domain-specific NER model with TAO Toolkit
> Deploy a production-level conversational AI application with a Helm Chart for scaling in Kubernetes clusters

Upon completion, you’ll be able to build Conversational AI applications and deploy them as services.

Audience Level: Intermediate Technical

Prerequisite(s):
> Familiarity with defensive cybersecurity themes
> Professional data science and/or data analysis experience
> Competency with the Python programming language
> Competency with the Linux command line

Session Abstract: The NVIDIA Morpheus AI framework lets cybersecurity developers and practitioners harness the power of GPU computing to implement cybersecurity solutions that perform on a scale never before possible. With Morpheus, cybersecurity developers can create optimized AI pipelines for filtering, processing, and classifying large volumes of real-time data. Bringing a new level of information security to data centers, Morpheus enables dynamic protection, real-time telemetry, and adaptive defenses for detecting and remediating cybersecurity threats.

In this workshop you will get hands-on experience solving real-world cybersecurity challenges using the NVIDIA Morpheus AI framework. By the time you complete this workshop you will:

> Be able to build end-to-end Morpheus pipelines to process and analyze massive data streams using NVIDIA GPUs and AI.
> Be able to fine-tune Morpheus's out-of-the-box AI toolkit for your organization's specific needs.
> Understand the key components of the Morpheus framework, how they work together, and how to get started with them on your own.

Audience Level: Advanced Technical

Prerequisite(s):
> Good understanding of PyTorch, deep learning and data parallel training concepts
> Practice with multi-GPU training and natural language processing are useful, but optional

Session Abstract: Very large deep neural networks (DNNs), whether applied to natural language processing (e.g., GPT-3), computer vision (e.g., huge Vision Transformers), or speech AI (e.g., Wave2Vec 2) have certain properties that set them apart from their smaller counterparts. As DNNs become larger and are trained on progressively larger datasets, they can adapt to new tasks with just a handful of training examples, accelerating the route toward general artificial intelligence. Training models that contain tens to hundreds of billions of parameters on vast datasets isn’t trivial and requires a unique combination of AI, high-performance computing (HPC), and systems knowledge. The goal of this course is to demonstrate how to train the largest of neural networks and deploy them to production.

In this workshop, you’ll learn how to:

> Train neural networks across multiple servers
> Use techniques such as activation checkpointing, gradient accumulation, and various forms of model parallelism to overcome the challenges associated with large-model memory footprint
> Capture and understand training performance characteristics to optimize model architecture
> Deploy very large multi-GPU models to production using NVIDIA Triton™ Inference Server

Audience Level: Beginner Technical

Prerequisite(s): Experience with Python, ideally including pandas and NumPy

Session Abstract: RAPIDS is a collection of data science libraries that allows end-to-end GPU acceleration for data science workflows. In this training, you'll:

> Use cuDF and Dask to ingest and manipulate massive datasets directly on the GPU
> Apply a wide variety of GPU-accelerated machine learning algorithms, including XGBoost, cuGRAPH, and cuML, to perform data analysis at massive scale
> Perform multiple analysis tasks on massive datasets in an effort to stave off a simulated epidemic outbreak affecting the UK

Upon completion, you'll be able to load, manipulate, and analyze data orders of magnitude faster than before, enabling more iteration cycles and drastically improving productivity.

難度級別：基礎技術

必備基礎能力：Python 與深度神經網路使用經驗

實作坊簡介：學習如何辨識時間序列資料中的異常和故障狀況、預估對應零件的剩餘使用年限，並將異常狀況與故障條件互相對應。

您將學習：

> 利用預測性維護來管理故障並避免代價高昂的意外停機
> 在偵測異常狀況時確認主要挑戰，以避免其導致代價高昂的故障
> 使用時間序列資料預測利用 XGBoost 機器學習分類模型的結果
> 使用以長短期記憶 (LSTM) 為基礎的模型應用預測性維護程序來預測設備故障
> 使用前面步驟中的時間序列來試驗自動編碼器以檢測異常

完成後，您將了解如何使用 AI 來預測設備狀況並估計何時應該進行維護。