Fix permissions for temp table from dataframe

Fixes an issue where data from a previous session for temporary tables that had yet to be auto-deleted prevented the table being recreated.

Temporary table from dataframe fix

Creating a temporary table from a dataframe would append the data when run successively, this fix creates the table afresh each time.

Create a temporary table from dataframe

v5.2.0 - 2022-02-28

Added

Function that creates a temporary table from a pandas.DataFrame, see pydbtools.dataframe_to_temp_table.

Save query to parquet

Added

• Function that saves the result of SQL query to a parquet file, see pydbtools.save_query_as_parquet. This is required for dbtools.

New AP compatibility

Added

• Functions that read SQL from strings of multiple statements, see pydbtools.read_sql_queries and pydbtools.read_sql_queries_gen.
• Functions that delete database entities and the S3 data for those entities, see pydbtools.delete_database_and_data, pydbtools.delete_table_and_data and pydbtools.delete_partitions_and_data.

Changed

• Temporary database names are now compatible with EKS.
• ctas_approach now defaults to True, the default behaviour for awswrangler, using a temporary database.
• Queries automatically use values for pyarrow_additional_kwargs that solve this awswrangler issue

v4.0.1: Updating dependencies (#48)

Updating dependencies

jinja templating

v4 release (#47)

See changelog

v3.1.1: bug fix for pydbtools (#46)

Bug fix - see changelog

v3.1.0

Create poetry-pypi-release.yml

Add logging

See https://github.com/moj-analytical-services/pydbtools/blob/master/CHANGELOG.md#v301---2021-02-12