Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[docs] add docs for PipesEMRContainersClient #27159

Merged
merged 1 commit into from
Jan 21, 2025

Conversation

danielgafni
Copy link
Contributor

@danielgafni danielgafni commented Jan 16, 2025

Summary & Motivation

This PR adds docs for the new PipesEMRContainersCient.

It sounds confusing but AWS EMR Containers and AWS EMR on EKS is actually the same thing.
The former is the name of the AWS API, and the latter is the service name (sounds like the same thing huh?) which is more used in human language rather than automation.

For example, the boto3 client is called emr-containers.

I tried to preserve this differentiation in these docs.

How I Tested These Changes

The snippets were tested with a real EMR on EKS cluster.

Copy link
Contributor Author

This stack of pull requests is managed by Graphite. Learn more about stacking.

@danielgafni danielgafni changed the title [docs] add docs for PipesEMRContainers [docs] add docs for PipesEMRContainersClient Jan 16, 2025
@danielgafni danielgafni marked this pull request as ready for review January 16, 2025 16:07
@danielgafni danielgafni requested a review from neverett as a code owner January 16, 2025 16:07
@danielgafni danielgafni force-pushed the 01-16-_docs_add_docs_for_pipesemrcontainers branch 2 times, most recently from aa0ea18 to 19c94d2 Compare January 16, 2025 16:11
@danielgafni
Copy link
Contributor Author

danielgafni commented Jan 16, 2025

@neverett I'm not sure why but the page is not available here? The new file is docs/content/concepts/dagster-pipes/aws-emr-containers.mdx- seems correct to me...

@danielgafni danielgafni requested a review from cmpadden January 16, 2025 16:14
Copy link

github-actions bot commented Jan 16, 2025

Deploy preview for dagster-docs-beta ready!

Preview available at https://dagster-docs-beta-2glwctjpf-elementl.vercel.app

Direct link to changed pages:

Copy link
Contributor Author

Hey @neverett @cmpadden, could you take a look, please?

@neverett neverett added the docs-to-migrate Docs to migrate to new docs site label Jan 21, 2025
@neverett
Copy link
Contributor

neverett commented Jan 21, 2025

@neverett I'm not sure why but the page is not available here? The new file is docs/content/concepts/dagster-pipes/aws-emr-containers.mdx- seems correct to me...

Yeah, the new file looks correct to me too -- I wonder if your recent changes aren't showing up because there are merge conflicts, since I'm also not seeing your updates to dagster-pipes.mdx in the preview.

Just as a heads up, we're moving to a new docs platform this Thursday, so future docs changes should be made to the files in docs_beta/docs. The new Pipes docs live in docs_beta/docs/guides/build/external-pipelines/.

@danielgafni
Copy link
Contributor Author

Alright! Thanks!

@danielgafni danielgafni force-pushed the 01-16-_docs_add_docs_for_pipesemrcontainers branch 2 times, most recently from ef07531 to 420f265 Compare January 21, 2025 20:55
@danielgafni danielgafni force-pushed the 01-16-_docs_add_docs_for_pipesemrcontainers branch from 420f265 to 5a51e2b Compare January 21, 2025 20:58
@danielgafni danielgafni merged commit 9639a9e into master Jan 21, 2025
6 of 7 checks passed
@danielgafni danielgafni deleted the 01-16-_docs_add_docs_for_pipesemrcontainers branch January 21, 2025 22:00
alangenfeld pushed a commit that referenced this pull request Jan 23, 2025
## Summary & Motivation

This PR adds docs for the new PipesEMRContainersCient. 

It sounds confusing but AWS EMR Containers and AWS EMR on EKS is
actually the same thing.
The former is the name of the AWS API, and the latter is the service
name (sounds like the same thing huh?) which is more used in human
language rather than automation.

For example, the `boto3` client is called `emr-containers`. 

I tried to preserve this differentiation in these docs.

## How I Tested These Changes

The snippets were tested with a real EMR on EKS cluster.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docs-to-migrate Docs to migrate to new docs site
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants