You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
action to be triggered by certain events in the pipeline can be delegated by the pipeline developer. examples of events and actions:
load job permanently failed. user code gets error message, can inspect the affected file and make decision to proceed or abort the whole load
new table or new column was inferred. user may change the data type, write disposition or ignore the change (which will drop the data)
variant column is being created due to inconsistent types. options as above
value cannot be coerced into the column type. user can provide custom casting function (ie. for text->datetime conversions)
relational json normalizer recurs into nested table and calls a hook. based on table name, parent table name, nesting level etc. you can decide to create complex type that will serialize the nested elements into json or proceed with recursion or drop the data
when writing text value into the loader file we exceed VARCHAR(MAX) length: user can cut the string or raise error (or ignore and try his luck)
action to be triggered by certain events in the pipeline can be delegated by the pipeline developer. examples of events and actions:
[we need more events]
we need a clean way to define and add hook functions. investigate if https://github.com/getslash/gossip fits.
The text was updated successfully, but these errors were encountered: