Skip to content

Commit

Permalink
[TDX] Increased VLLM memory resources
Browse files Browse the repository at this point in the history
Signed-off-by: Jakub Ledworowski <[email protected]>
  • Loading branch information
JakubLedworowski committed Feb 12, 2025
1 parent da91d5a commit 7b6e136
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion helm-charts/TDX.md
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,7 @@ Follow the steps below to deploy ChatQnA:
--set retriever-usvc.tdxEnabled=true --set retriever-usvc.resources.limits.memory=8Gi \
--set tei.tdxEnabled=true --set tei.resources.limits.memory=8Gi \
--set teirerank.tdxEnabled=true --set teirerank.resources.limits.memory=8Gi \
--set vllm.tdxEnabled=true --set vllm.resources.limits.memory=8Gi
--set vllm.tdxEnabled=true --set vllm.resources.limits.memory=48Gi
```

> [!NOTE]
Expand Down

0 comments on commit 7b6e136

Please sign in to comment.