hailin
/
sglang_v0.5.2
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
sglang_v0.5.2/pytorch_2.8.0/docs/source/distributed.algorithms.join.md

647 B
Raw Blame History 

---
class: hidden-section
---

Generic Join Context Manager

The generic join context manager facilitates distributed training on uneven inputs. This page outlines the API of the relevant classes: {class}Join, {class}Joinable, and {class}JoinHook. For a tutorial, see Distributed Training with Uneven Inputs Using the Join Context Manager.

.. autoclass:: torch.distributed.algorithms.Join
    :members:

.. autoclass:: torch.distributed.algorithms.Joinable
    :members:

.. autoclass:: torch.distributed.algorithms.JoinHook
    :members: