sglang_v0.5.2/pytorch_2.8.0/torch/distributed/pipelining/README.md

343 B

Pipeline Parallelism for PyTorch

torch.distributed.pipelining is a package for implementing pipeline parallelism on your model.

Our documentation is available here.

pipeline_diagram_web