Traditional methods for processing lidar data pose significant challenges, such as the ability to detect and classify different types of objects, scenes and weather conditions, as well as limitations in performance and robustness. Our multi-view LidarNet deep neural network uses multiple perspectives, or views, of the scene around the car to address these lidar processing challenges.