NVIDIA Mellanox InfiniBand SHARP, In-Network Computing offloads collective communication operations from the CPU to the switch network, decreasing the amount of data traversing the network, dramatically reducing the time of Message Passing Interface (MPI) operations, and improving application performance by an order of magnitude.