Ways to Get Started With NVIDIA NeMo

NVIDIA NeMo is an agent-first, open suite of libraries and skills for accelerating AI agent specialization, optimization, and governance.

NeMo integrates with existing AI tools and agent frameworks to optimize specialized agents across any cloud, on-premises, or hybrid environment.

NeMo is available open source and supported as part of NVIDIA AI Enterprise. Pricing and licensing details can be found here.

NeMo can be used to customize large language models (LLMs), vision language models (VLMs),  automatic speech recognition (ASR), and text-to-speech (TTS) models.

NVIDIA AI Enterprise includes NVIDIA Business-Standard Support. For additional available support and services, such as NVIDIA Business-Critical Support, a technical account manager, training, and professional services, see the NVIDIA Enterprise Support and Service Guide.

NVIDIA NeMo framework is an open-source generative AI framework built for researchers and developers who are looking for fine-grained control and code-level flexibility to efficiently build generative AI models at scale. It supports pretraining, post-training, and reinforcement learning of multimodal generative AI models.


NVIDIA NeMo microservices is an enterprise-ready, API-first modular offering built on the NeMo framework, to enable developers to easily and rapidly customize and deploy AI agents at scale. It simplifies model fine-tuning, evaluation, guardrailing, and synthetic data generation. They seamlessly integrate into existing AI platforms, enabling enterprises to accelerate custom AI agent development and continuously optimize them through data flywheel workflows.

NeMo Curator is an open-source library that improves generative AI model accuracy by curating high-quality multimodal datasets. It consists of a set of Python modules expressed as APIs that make use of Dask, cuDF, cuGraph, and Pytorch to scale data curation tasks, such as data download, text extraction, cleaning, filtering, exact/fuzzy deduplication, and text classification to thousands of compute cores

NeMo Data Designer is a purpose-built microservice (also available as an open library) for AI developers that provides a programmatic way to generate synthetic data through configurable schemas and AI-powered generation models. It’s designed to integrate seamlessly into your AI development workflow.

NeMo Anonymizer is an open library that supports context-aware data anonymization within free text. After detecting sensitive entities, you can label, redact, hash, replace, or fully rewrite them.

NeMo Safe Synthesizer is an open library for generating synthetic versions of sensitive datasets. It creates entirely novel records with no one-to-one mapping to the original. It unlocks insights of your data while maintaining data privacy.

NeMo Customizer is a high-performance, scalable microservice that simplifies the customization and alignment of LLMs for domain-specific use cases using advanced fine-tuning and reinforcement learning techniques.

NeMo Auditor probes LLMs offline, in batch, with a wide range of automated attacks and edge-case prompts to uncover safety and security vulnerabilities. It’s built on the open NVIDIA Garak library and is designed to plug in to evaluation workflows and CI/CD pipelines, so teams can regularly run audits and use the resulting reports to harden models and deployments over time.

NeMo Evaluator provides scalable benchmarking for generative AI applications, including LLMs, RAG pipelines, and AI agents. It features an open source SDK for flexible experimentation with over 100 benchmarks, alongside a cloud-native microservice that automates enterprise-grade evaluation workflows using LLM-as-a-judge scoring and specialized performance metrics.

NeMo RL is an open source library for advanced reinforcement learning algorithms and scalable post-training to optimize and align AI agents at enterprise scale.

NeMo Gym is an open source library for building reinforcement learning (RL) training environments for large language models (LLMs). NeMo Gym provides infrastructure to develop environments, scale rollout collection, and integrate seamlessly with your preferred training framework. It helps generate data needed for RL training to equip AI agents and models with domain-specific skills.

NeMo Retriever is an open source library, featuring Nemotron RAG models, for building scalable pipelines to extract multimodal data from complex documents that delivers up to 50% better accuracy and 15x faster multimodal PDF extraction.

NeMo Relay is an integration layer for connecting black-box and general-purpose agent harnesses into the NeMo Platform. It helps teams bring existing agent workflows into NeMo so they can use platform capabilities for optimization, evaluation, and continuous improvement without rebuilding their agent stack from scratch.

NVIDIA NIM, part of NVIDIA AI Enterprise, is an easy-to-use runtime designed to accelerate the deployment of generative AI across enterprises. This versatile microservice supports a broad spectrum of AI models—from open-source community models to NVIDIA AI Foundation models, as well as bespoke custom AI models. Built on the robust foundations of the inference engines, it’s engineered to facilitate seamless AI inferencing at scale, ensuring that AI applications can be deployed across the cloud, data center, and workstation.

Retrieval-augmented generation is a technique that lets LLMs create responses from the latest information by connecting them to the company’s knowledge base. NeMo works with various third-party and community tools, including Milvus, Llama Index, and LangChain, to extract relevant snippets of information from the vector database and feed them to the LLM to generate responses in natural language. Explore the AI Chatbot Using RAG Workflow page to get started building production-quality AI chatbots that can accurately answer questions about your enterprise data.

NVIDIA Blueprints are comprehensive reference workflows built with NVIDIA Nemotron open models and libraries. Each blueprint includes reference code, deployment tools, customization guides, and a reference architecture, accelerating the deployment of AI solutions like AI agents and digital twins, from prototype to production.

NVIDIA AI Enterprise brings together microservices, frameworks, and libraries for AI development with advanced GPU orchestration and infrastructure management in a fully supported, production-ready, commercial software suite. Deploy leading open source tools and AI models with confidence, improve productivity and time to value, and run AI workloads at scale with optimized resource utilization.