.. role:: hidden
:class: hidden-section
Distributed Optimizers
:::{warning}
Distributed optimizer is not currently supported when using CUDA tensors
:::
.. automodule:: torch.distributed.optim
:members: DistributedOptimizer, PostLocalSGDOptimizer, ZeroRedundancyOptimizer