Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a how to guide showing how to dynamically create flows #2042

Open
anna-geller opened this issue Dec 18, 2024 · 0 comments
Open

Add a how to guide showing how to dynamically create flows #2042

anna-geller opened this issue Dec 18, 2024 · 0 comments
Labels
documentation Improvements or additions to documentation

Comments

@anna-geller
Copy link
Member

anna-geller commented Dec 18, 2024

Description

So far, we have this guide from Antoine showing how they dynamically generate a bunch of flows via Terraform: https://kestra.io/docs/how-to-guides/terraform-templating + https://kestra.io/docs/how-to-guides/terraform-modules-for-triggers

We could add a page "How to dynamically generate flows" which shows 2 other ways to create flows dynamically:

  1. A cookie-cutter flow providing flow template, filling in values from inputs and creating flows dynamically based on provided inputs
  2. Direct API calls in the style how we did it e.g. for dbt to create kestra task per each dbt model dynamically https://github.com/kestra-io/dbt-example/tree/demo
curl -X POST http://localhost:8080/api/v1/flows/import -F fileUpload=@generate_flow_with_dbt_dag.yaml
curl -X POST http://localhost:8080/api/v1/executions/company.datateam.dbt/generate_flow_with_dbt_dag?wait=true
@anna-geller anna-geller added the documentation Improvements or additions to documentation label Dec 18, 2024
@kestrabot kestrabot bot added this to Issues Dec 18, 2024
@github-project-automation github-project-automation bot moved this to Backlog in Issues Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
Status: Backlog
Development

No branches or pull requests

2 participants