Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat/initial setup #1

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Feat/initial setup #1

wants to merge 4 commits into from

Conversation

MikaGie
Copy link
Collaborator

@MikaGie MikaGie commented Oct 1, 2024

What does this PR do?

This is an initial setup of this repository.

This pipeline loads data from table Availability in Airtable to Snowflake

How to test and verify changes (mandatory)

  • Check out the code
  • Run chmod +x setup.sh && ./setup.sh and enter your snowflake credentials, database etc. when prompted
  • Ask Mikaela for token to Airtable
  • Add token to your .envrc or .env file (use name SOURCE__AIRTABLE__CREDENTIALS__TOKEN)
  • Run poetry run dagster dev
  • Materialize the airtable asset
  • Go to snowflake and check if you have tables under schema raw_airtable. You should have the ones in the image below
    image

Link to Jira Ticket

https://invativa.atlassian.net/browse/COF-208

Final commit message

<type>(<scope>): <subject> (#<PR number>)

Replace <type> with one of the following

  • fix: Code change that fixes a bug (PATCH in Semantic Versioning)
  • feat: Code change that introduces a new feature (MINOR in Semantic Versioning)
  • BREAKING CHANGE: Code change that is not backwards compatible (MAJOR in Semantic Versioning)

Screenshots (optional)

@MikaGie MikaGie requested review from chmr25 and reinthal and removed request for chmr25 October 1, 2024 14:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant