Skip to content

Commit

Permalink
Ryan's comments
Browse files Browse the repository at this point in the history
  • Loading branch information
slorello89 committed Jul 11, 2023
1 parent 7c1de36 commit c3940a9
Show file tree
Hide file tree
Showing 3 changed files with 4 additions and 3 deletions.
2 changes: 1 addition & 1 deletion Dockerfile
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
FROM nvcr.io/nvidia/tritonserver:23.05-py3
FROM nvcr.io/nvidia/tritonserver:23.06-py3

RUN mkdir /opt/tritonserver/caches/redis
COPY ./build/install/caches/redis/libtritoncache_redis.so /opt/tritonserver/caches/redis
3 changes: 2 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -113,6 +113,7 @@ Optionally you may configure your `user`/`password` via environment variables. T
Transport Layer Security (TLS) can be enabled in Redis and within the Triton Redis Cache, to do so you will need a TLS
enabled version of Redis, e.g. [OSS Redis](https://redis.io/docs/management/security/encryption/) or
[Redis Enterprise](https://docs.redis.com/latest/rs/security/tls/enable-tls/). You will also need to configure Triton Server to use TLS with Redis
through the following `--cache-config` TLS options.

#### Configuration Items for TLS

Expand Down Expand Up @@ -157,7 +158,7 @@ Password: <MY API KEY>
> NOTE: Username: $oauthtoken in this context means that your username is literally $oauthtoken - your API key serves as the unique part of your credentials
* run `docker-compose build`
* run `docker-compose up`
* In a separate terminal run `docker run -it --rm --net=host nvcr.io/nvidia/tritonserver:23.03-py3-sdk`
* In a separate terminal run `docker run -it --rm --net=host nvcr.io/nvidia/tritonserver:23.06-py3-sdk`
* Run `/workspace/install/bin/image_client -m densenet_onnx -c 3 -s INCEPTION /workspace/images/mug.jpg`
* on the first run - this will miss the cache
* subsequent runs will pull the inference out of the cache
Expand Down
2 changes: 1 addition & 1 deletion examples/tls/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ This environment demonstrates how to run the Triton Redis Cache against a TLS en
* follow build instructions enumerated [in the README](https://github.com/triton-inference-server/redis_cache#build-the-cache)
* cd into `redis_cache/docker/tls`
* run `sh run-tls.sh`
* In a separate terminal run `docker run -it --rm --net=host nvcr.io/nvidia/tritonserver:23.03-py3-sdk`
* In a separate terminal run `docker run -it --rm --net=host nvcr.io/nvidia/tritonserver:23.06-py3-sdk`
* Run `/workspace/install/bin/image_client -m densenet_onnx -c 3 -s INCEPTION /workspace/images/mug.jpg`
* on the first run - this will miss the cache
* subsequent runs will pull the inference out of the cache
Expand Down

0 comments on commit c3940a9

Please sign in to comment.