sglang_v0.5.2/flashinfer_0.3.1/docs/api/green_ctx.rst

18 lines
326 B
ReStructuredText

.. _apigreenctx:
flashinfer.green_ctx
====================
.. currentmodule:: flashinfer.green_ctx
This module provides utilities for creating CUDA green contexts.
Green context creation
----------------------
.. autosummary::
:toctree: ../generated
split_device_green_ctx
split_device_green_ctx_by_sm_count