hailin
/
sglang_v0.5.2
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
sglang_v0.5.2/pytorch_2.8.0/docs/source/cuda.tunable.md

1.3 KiB
Raw Permalink Blame History 

.. currentmodule:: torch.cuda.tunable

TunableOp

Overview

.. automodule:: torch.cuda.tunable

API Reference

.. autofunction:: enable

.. autofunction:: is_enabled

.. autofunction:: tuning_enable

.. autofunction:: tuning_is_enabled

.. autofunction:: record_untuned_enable

.. autofunction:: record_untuned_is_enabled

.. autofunction:: set_max_tuning_duration

.. autofunction:: get_max_tuning_duration

.. autofunction:: set_max_tuning_iterations

.. autofunction:: get_max_tuning_iterations

.. autofunction:: set_filename

.. autofunction:: get_filename

.. autofunction:: get_results

.. autofunction:: get_validators

.. autofunction:: write_file_on_exit

.. autofunction:: write_file

.. autofunction:: read_file

.. autofunction:: tune_gemm_in_file

.. autofunction:: mgpu_tune_gemm_in_file

.. autofunction:: set_rotating_buffer_size

.. autofunction:: get_rotating_buffer_size