data parallelism, model parallelism, gradient synchronization, FSDP
Press ? anytime to show this help