sglang_v0.5.2/flashinfer_0.3.1/flashinfer/cudnn/__init__.py

3 lines
108 B
Python

from .decode import cudnn_batch_decode_with_kv_cache
from .prefill import cudnn_batch_prefill_with_kv_cache