19 lines
330 B
ReStructuredText
19 lines
330 B
ReStructuredText
.. _apipage:
|
|
|
|
flashinfer.page
|
|
===============
|
|
|
|
Kernels to manipulate paged kv-cache.
|
|
|
|
.. currentmodule:: flashinfer.page
|
|
|
|
Append new K/V tensors to Paged KV-Cache
|
|
----------------------------------------
|
|
|
|
.. autosummary::
|
|
:toctree: ../generated
|
|
|
|
append_paged_kv_cache
|
|
append_paged_mla_kv_cache
|
|
get_batch_indices_positions
|