NVIDIA Interview Question

What is Tensor Parallelism (TP)?