File tree Expand file tree Collapse file tree 1 file changed +2
-2
lines changed Expand file tree Collapse file tree 1 file changed +2
-2
lines changed Original file line number Diff line number Diff line change @@ -84,7 +84,7 @@ model=HuggingFaceH4/zephyr-7b-beta
8484volume=$PWD /data
8585
8686docker run --gpus all --shm-size 1g -p 8080:80 -v $volume :/data \
87- ghcr.io/huggingface/text-generation-inference:3.3.2 --model-id $model
87+ ghcr.io/huggingface/text-generation-inference:3.3.3 --model-id $model
8888```
8989
9090And then you can make requests like
@@ -152,7 +152,7 @@ volume=$PWD/data # share a volume with the Docker container to avoid downloading
152152token=< your cli READ token>
153153
154154docker run --gpus all --shm-size 1g -e HF_TOKEN=$token -p 8080:80 -v $volume :/data \
155- ghcr.io/huggingface/text-generation-inference:3.3.2 --model-id $model
155+ ghcr.io/huggingface/text-generation-inference:3.3.3 --model-id $model
156156```
157157
158158### A note on Shared Memory (shm)
You can’t perform that action at this time.
0 commit comments