NVIDIA Graphics Delivery Network

Solutions: AI Workflows

Multi-Camera Tracking

Track objects and the customer journey across multiple cameras throughout the store.

Learn More

    What is Multi-Camera Tracking?

    Retail spaces are gaining valuable insight into the movement of objects and customers by applying computer vision AI to many cameras covering multiple physical areas. The multi-camera tracking AI workflow uses the NVIDIA DeepStream SDK and delivers multi-target multi-camera (MTMC) capabilities to track objects and store associates across cameras.

    Read More About Retail AI Workflows

    Explore the Multi-Camera AI Workflow

    This AI workflow uses the NVIDIA DeepStream SDK, pretrained models, and new state-of-the-art microservices to deliver advanced multi-target, multi-camera (MTMC) capabilities. Developers can now more easily create systems that track objects across multiple cameras throughout a retail store or warehouse.

    This MTMC workflow tracks and associates objects across cameras and maintains a unique ID for each object. This ID is tracked through visual embeddings/appearance rather than any personal biometric information, so privacy is fully maintained.

    MTMC capabilities help bolster the security of self-checkout and are foundational for fully autonomous stores. The workflow can also be trained to detect anomalous behavior and be deployed and scaled with Kubernetes and managed by Helm.

    The workflow contains:

    • Object detection and creation of feature embeddings.
    • Multi-camera tracking microservice based on object embedding and spatial temporal information.
    • Global ID generation for each uniquely identified object.
    • Information storage and output.
    • A customizable reference application for deploying in production.
    • Guidance on how to train and customize the AI workflow.

    The multi-camera tracking application can be broken down into three key components: detection and single-camera tracking, multi-camera tracking, and storage and output. Live RTSP streams from cameras go through the detection and tracking microservices to generate feature embeddings of an object that are representative of its appearance. This metadata is sent downstream over a broker to other microservices. Metadata is picked up by a multi-camera tracking service, which takes specific data, fuses and synchronizes the data together, and correlates it across cameras. It will identify objects based on feature embeddings and the spatial temporal information that compares the time and space vector of the objects and correlates from different cameras to associate that the objects are the same. Finally, this generates a global ID for each uniquely identified object that will remain common across all cameras.

    Read the Technical Blog

    Apply for Early Access

    Please complete this short application for early access to the multi-camera tracking AI workflow.

    Please note that you must be a registered NVIDIA Developer to join the program. Log in using your organizational email address. We cannot accept applications from accounts using Gmail, Yahoo, QQ, or other personal email addresses.

    Apply Now

    Multi-Target Multi-Camera Tracking Made Easy

    Watch the Video

    Key Benefits of the Multi-Camera AI Workflow

    Pretrained Models

    Highly accurate models are provided to enable identifying objects and creating a unique global ID based on embeddings/appearance rather than any personal biometric information.

    Multi-Camera Tracking

    A state-of-the-art microservice that uses objects’ feature embeddings, along with spatial temporal information, to uniquely identify and associate objects across cameras.

    Flexible Reference Architecture

    Delivered through cloud-native microservices, this AI workflow allows for jump-starting development and ease of customization to rapidly create solutions requiring cross-camera object tracking.

    Accelerate the Development of AI Solutions

    AI workflows accelerate the path to AI outcomes. The multi-camera AI workflow provides a reference for developers to rapidly get started in creating a flexible and scalable MTMC AI solution.

    Reduce Development Time

    Best-in-class AI software streamlines development and deployment of AI solutions.

    Improve Accuracy And Performance

    Frameworks and containers are performance-tuned and tested for NVIDIA GPUs.

    Speed Time to Deployment

    Access prepackaged, customizable reference applications deployable in the cloud.

    Gain Confidence in AI Outcomes

    Cloud-native NVIDIA Metropolis microservices are designed to deploy at scale with Kubernetes and manage with HELM.

    Learn More About AI-Based Workflows for Retail

    The $100B Retail Problem

    Read more about how NVIDIA is helping the retail industry tackle its $100 Billion annual shrinkage problem.

    Learn More

    Read the Technical Blog

    Learn how the retail AI workflows address highly complex application development challenges and provide the initial ‘building blocks’ necessary to build an effective solution.

    Read Now

    Apply for Early Access

    Want to get started? Apply for early access and get a jump start on creating a flexible and scalable loss prevention AI solution.

    Apply Here

    Sign up to receive the latest retail AI news from NVIDIA.

    Sign Up
    Products
    Technologies
    Resources
    Company Info