hailin
/
sglang_v0.5.2
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
sglang_v0.5.2/sglang/python/sglang/srt/constants.py

4 lines
93 B
Python
Raw Blame History

# GPU Memory Types
GPU_MEMORY_TYPE_KV_CACHE = "kv_cache"
GPU_MEMORY_TYPE_WEIGHTS = "weights"
Reference in New Issue View Git Blame Copy Permalink