23 lines
461 B
ReStructuredText
23 lines
461 B
ReStructuredText
.. _apirope:
|
|
|
|
flashinfer.rope
|
|
===============
|
|
|
|
Kernels for applying rotary embeddings.
|
|
|
|
.. currentmodule:: flashinfer.rope
|
|
|
|
.. autosummary::
|
|
:toctree: ../generated
|
|
|
|
apply_rope_inplace
|
|
apply_llama31_rope_inplace
|
|
apply_rope
|
|
apply_llama31_rope
|
|
apply_rope_pos_ids
|
|
apply_rope_pos_ids_inplace
|
|
apply_llama31_rope_pos_ids
|
|
apply_llama31_rope_pos_ids_inplace
|
|
apply_rope_with_cos_sin_cache
|
|
apply_rope_with_cos_sin_cache_inplace
|