sglang_v0.5.2/build_lora_image.sh

2 lines
235 B
Bash
Executable File

docker build --build-arg http_proxy=http://127.0.0.1:7890 --build-arg https_proxy=http://127.0.0.1:7890 --network=host --build-arg CUDA_VERSION=12.6.1 --target runtime-autobuild --build-arg MAX_JOBS=96 --load -t sglang_lora .