[docs] RAG Tutorial #27304
Merged
[docs] RAG Tutorial #27304
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![graphite-app[bot]](https://avatars.githubusercontent.com/in/158384?s=60&v=4){kind=small}
dehume
force-pushed
the
dennis/doc-765-pinecone-content
branch
from
e2d233a to
5aef46b
Compare
|
|
||
| To make sure Dagster and its dependencies were installed correctly, navigate to the project root directory and start the Dagster webserver: | ||
|
|
||
| followed by a bash code snippet for |
There was a problem hiding this comment.
This line appears to be an incomplete sentence fragment that was likely left over during editing. Removing it will improve the documentation's clarity since the code block that follows stands on its own.
Spotted by Graphite Reviewer
Is this helpful? React 👍 or 👎 to let us know.
|
|
||
| First, set up a new Dagster project. | ||
|
|
||
| 1. Clone the the [Dagster repo](https://github.com/dagster-io/dagster) and navigate to the project: |
There was a problem hiding this comment.
Remove the duplicate word "the" in "Clone the the [Dagster repo]"
Spotted by Graphite Reviewer
Is this helpful? React 👍 or 👎 to let us know.
neverett
approved these changes
Jan 23, 2025
Co-authored-by: Nikki Everett <[email protected]>
|
|
||
| <CodeExample path="project_ask_ai_dagster/project_ask_ai_dagster/assets/ingestion.py" language="python" lineStart="15" lineEnd="53"/> | ||
|
|
||
| The next asset will convert those `Documents` to vectors and upload them to Pinecone. In order to generate the embeddings, we will need an AI model. In this case, we will use OpenAI's `text-embedding-3-small` model to transform the text we have collected from GitHub into embeddings. Dagster provides an `OpenAIResource` to interact with the OpenAI client ,and we will use that to create the embeddings. This asset will also create the index in Pinecone: |
There was a problem hiding this comment.
Remove the space before the comma in OpenAI client ,and to fix the punctuation.
Spotted by Graphite Reviewer
Is this helpful? React 👍 or 👎 to let us know.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary & Motivation
Tutorial for Ask AI
How I Tested These Changes
Changelog