Merge branch 'main' into sdk-tests

MeltanoLabs · Nov 25, 2023 · cc5ecd9 · cc5ecd9
2 parents 0c09461 + 8262aeb
commit cc5ecd9
Show file tree

Hide file tree

Showing 7 changed files with 472 additions and 297 deletions.
diff --git a/.pre-commit-config.yaml b/.pre-commit-config.yaml
@@ -18,7 +18,7 @@ repos:
   - id: trailing-whitespace
 
 - repo: https://github.com/psf/black
-  rev: 23.10.0
+  rev: 23.11.0
   hooks:
   - id: black
     exclude: |
@@ -46,7 +46,7 @@ repos:
     args: [--py37-plus]
 
 - repo: https://github.com/pre-commit/mirrors-mypy
-  rev: 'v1.6.1'
+  rev: 'v1.7.0'
   hooks:
   - id: mypy
     exclude: tests

diff --git a/README.md b/README.md
@@ -149,3 +149,69 @@ meltano invoke target-postgres --version
 
 See the [dev guide](https://sdk.meltano.com/en/latest/dev_guide.html) for more instructions on how to use the Meltano SDK to
 develop your own Singer taps and targets.
+
+## Data Types
+
+The below table shows how this tap will map between jsonschema datatypes and Postgres datatypes.
+
+| jsonschema                     | Postgres                                |
+|--------------------------------|-----------------------------------------|
+| integer                        | bigint                                  |
+| UNSUPPORTED                    | bigserial                               |
+| UNSUPPORTED                    | bit [ (n) ]                             |
+| UNSUPPORTED                    | bit varying [ (n) ]                     |
+| boolean                        | boolean                                 |
+| UNSUPPORTED                    | box                                     |
+| UNSUPPORTED                    | bytea                                   |
+| UNSUPPORTED                    | character [ (n) ]                       |
+| UNSUPPORTED                    | character varying [ (n) ]               |
+| UNSUPPORTED                    | cidr                                    |
+| UNSUPPORTED                    | circle                                  |
+| string with format="date"      | date                                    |
+| UNSUPPORTED                    | double precision                        |
+| UNSUPPORTED                    | inet                                    |
+| UNSUPPORTED                    | integer                                 |
+| UNSUPPORTED                    | interval [ fields ] [ (p) ]             |
+| UNSUPPORTED                    | json                                    |
+| array; object                  | jsonb                                   |
+| UNSUPPORTED                    | line                                    |
+| UNSUPPORTED                    | lseg                                    |
+| UNSUPPORTED                    | macaddr                                 |
+| UNSUPPORTED                    | macaddr8                                |
+| UNSUPPORTED                    | money                                   |
+| number                         | numeric [ (p, s) ]                      |
+| UNSUPPORTED                    | path                                    |
+| UNSUPPORTED                    | pg_lsn                                  |
+| UNSUPPORTED                    | pg_snapshot                             |
+| UNSUPPORTED                    | point                                   |
+| UNSUPPORTED                    | polygon                                 |
+| UNSUPPORTED                    | real                                    |
+| UNSUPPORTED                    | smallint                                |
+| UNSUPPORTED                    | smallserial                             |
+| UNSUPPORTED                    | serial                                  |
+| string without format; untyped | text                                    |
+| string with format="time"      | time [ (p) ] [ without time zone ]      |
+| UNSUPPORTED                    | time [ (p) ] with time zone             |
+| string with format="date-time" | timestamp [ (p) ] [ without time zone ] |
+| UNSUPPORTED                    | timestamp [ (p) ] with time zone        |
+| UNSUPPORTED                    | tsquery                                 |
+| UNSUPPORTED                    | tsvector                                |
+| UNSUPPORTED                    | txid_snapshot                           |
+| UNSUPPORTED                    | uuid                                    |
+| UNSUPPORTED                    | xml                                     |
+
+Note that while object types are mapped directly to jsonb, array types are mapped to a jsonb array.
+
+If a column has multiple jsonschema types, the following order is using to order Postgres types, from highest priority to lowest priority.
+- ARRAY(JSONB)
+- JSONB
+- TEXT
+- TIMESTAMP
+- DATETIME
+- DATE
+- TIME
+- DECIMAL
+- BIGINT
+- INTEGER
+- BOOLEAN
+- NOTYPE