Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add "CrateDB" utility plugin #1

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions _data/default_variants.yml
Original file line number Diff line number Diff line change
Expand Up @@ -664,6 +664,7 @@ transforms:
utilities:
airflow: apache
clickhouse: clickhouse
cratedb: cratedb
cron: meltano
dagster: quantile-development
datahub: datahub-project
Expand Down
4 changes: 4 additions & 0 deletions _data/maintainers.yml
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,10 @@ alvaroraul7:
label: alvaroraul7
name: alvaroraul7
url: https://github.com/AlvaroRaul7
amotl:
label: Andreas Motl
name: amotl
url: https://github.com/amotl
andrejakobsen:
label: Kristian André Jakobsen
name: andrejakobsen
Expand Down
42 changes: 42 additions & 0 deletions _data/meltano/utilities/cratedb/cratedb.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
capabilities: []
commands:
start:
args: start
container_spec:
image: crate:latest
ports:
'4200': 4200/tcp
'5433': 5432/tcp
Copy link
Author

@amotl amotl Dec 8, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I discovered elsewhere that 5433 might be used for PostgreSQL/SSL within Meltano testing infra. Do you have a suggestion to use a different port? Maybe 6432?

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Anything would work, don't know, 15432 is also an option, maybe someone else has a better suggestion.

volumes:
- $MELTANO_PROJECT_ROOT/.meltano/utilities/cratedb/data:/data
definition: is a containerized single-node instance of CrateDB useful for local development.
description: CrateDB is a distributed and scalable SQL database for storing and analyzing
massive amounts of data in near real-time, even with complex queries. It is PostgreSQL-compatible,
and based on Lucene.
docs: https://cratedb.com/
domain_url: https://cratedb.com/
keywords:
- warehouse
label: CrateDB
logo_url: /assets/logos/utilities/cratedb.png
amotl marked this conversation as resolved.
Show resolved Hide resolved
maintenance_status: active
name: cratedb
namespace: cratedb
next_steps: |
1. Launch CrateDB:

```sh
meltano invoke --containers cratedb:start
```

Connect with your PostgreSQL client at `postgresql://crate@localhost:5433/`,
use SQLAlchemy with `crate://crate@localhost:4200/`, or use CrateDB shell
like `crash --host localhost:4200`.
prereq: |
#### Dependencies

CrateDB is packaged as a Docker image so you must have Docker installed before running the plugin.
repo: https://github.com/crate/crate
settings: []
settings_group_validation: []
variant: cratedb
Binary file added static/assets/logos/utilities/cratedb.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.