Intel Corporation Interview Question

Explain Fully Sharded Data Parallel