diff --git a/README.md b/README.md index de1ab477..8a5d7d79 100644 --- a/README.md +++ b/README.md @@ -27,8 +27,25 @@ You can use a Docker container to try Optimum-NVIDIA today. Images are available docker pull huggingface/optimum-nvidia ``` - +Instead of using the pre-built docker container, you can build Optimum-NVIDIA from source: +```bash +TARGET_SM = "90-real,89-real" +git clone --recursive --depth=1 git@github.com:huggingface/optimum-nvidia.git +cd optimum-nvidia/third-party/tensorrt-llm +make -C docker release_build CUDA_ARCHS=$TARGET_SM +cd ../.. && docker build -t : -f docker/Dockerfile . +``` + + -An Optimum-NVIDIA package that can be installed with `pip` will be made available soon. - # Quickstart Guide ## Pipelines