sglang_v0.5.2/pytorch_2.8.0/torch/distributed/pipelining
hailin c8e8c1e9ff . 2025-09-20 16:09:34 +08:00
..
README.md . 2025-09-20 16:09:34 +08:00
_IR.py . 2025-09-20 16:09:34 +08:00
__init__.py . 2025-09-20 16:09:34 +08:00
_backward.py . 2025-09-20 16:09:34 +08:00
_debug.py . 2025-09-20 16:09:34 +08:00
_schedule_visualizer.py . 2025-09-20 16:09:34 +08:00
_unflatten.py . 2025-09-20 16:09:34 +08:00
_utils.py . 2025-09-20 16:09:34 +08:00
microbatch.py . 2025-09-20 16:09:34 +08:00
schedules.py . 2025-09-20 16:09:34 +08:00
stage.py . 2025-09-20 16:09:34 +08:00

README.md

Pipeline Parallelism for PyTorch

torch.distributed.pipelining is a package for implementing pipeline parallelism on your model.

Our documentation is available here.

pipeline_diagram_web