-
Notifications
You must be signed in to change notification settings - Fork 64
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[TDX] Added Intel TDX support to helm charts #799
base: main
Are you sure you want to change the base?
[TDX] Added Intel TDX support to helm charts #799
Conversation
a3571a5
to
a32c308
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should combine the common-library and tdx charts into a single tdx library chart. The benefit of using library chart can be found at here
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
After validation all services marked to be run with TDX works fine. E2E chatqna responses successfully
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Update helm install with following minimal resources required for TDX
Hi @lianhao, I tried to do it with a single library at the beginning, but the problem I faced is that there is a common logic for including podAnnotations. With annotations for Intel TDX we have to merge with the existing solution. That is why I introduced a common-library, which is always included and inside it checks if tdx values are present. If you have an idea how to make it a single library I am open to suggestions :) |
d8be139
to
a81a790
Compare
After a call we simplified the solution into a single library included as permanent dependency. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please fix the DCO issue. Others seems fine to me
8e8f6a5
to
3591d6c
Compare
Subcharts: - embedding-usvc - guardrails-usvc - llm-uservice - redis-vector-db - reranking-usvc - retriever-usvc - tei - teirerank - tgi - vllm Signed-off-by: Jakub Ledworowski <[email protected]>
for more information, see https://pre-commit.ci Signed-off-by: Jakub Ledworowski <[email protected]>
Signed-off-by: Jakub Ledworowski <[email protected]>
Signed-off-by: Jakub Ledworowski <[email protected]>
Signed-off-by: Jakub Ledworowski <[email protected]>
Signed-off-by: Jakub Ledworowski <[email protected]>
Signed-off-by: Jakub Ledworowski <[email protected]>
Subcharts: - ui - data-prep - nginx Signed-off-by: Jakub Ledworowski <[email protected]>
Signed-off-by: Jakub Ledworowski <[email protected]>
This reverts commit 0031ce3. Signed-off-by: Jakub Ledworowski <[email protected]>
Signed-off-by: Jakub Ledworowski <[email protected]>
Signed-off-by: Jakub Ledworowski <[email protected]>
Signed-off-by: Jakub Ledworowski <[email protected]>
Signed-off-by: Jakub Ledworowski <[email protected]>
Signed-off-by: Jakub Ledworowski <[email protected]>
Signed-off-by: Jakub Ledworowski <[email protected]>
Signed-off-by: Jakub Ledworowski <[email protected]>
3591d6c
to
f3031be
Compare
Description
Confidential computing in AI in the cloud focuses on protecting sensitive data and computations from unauthorized access and tampering. It uses advanced security technologies, such as hardware-based isolation and encryption, to create secure environments where data and AI models can be processed safely. This ensures that even cloud service providers cannot access the data, providing a higher level of privacy and security. By leveraging confidential computing, organizations can confidently use AI in the cloud for tasks that involve sensitive information, such as healthcare data analysis or financial predictions, while complying with strict data protection regulations.
Subcharts enabled to be run with Intel TDX:
Issues
List the issue or RFC link this PR is working on. If there is no such link, please mark it as
n/a
.Type of change
List the type of change like below. Please delete options that are not relevant.
Dependencies
List the newly introduced 3rd party dependency if exists.
Tests
Tested the generated templates with and without Intel TDX.
Tested the deployment of
chatqna
example on the running cluster.