[DO NOT MERGE] add support for data source#2990

Draft

sfc-gh-aling wants to merge 12 commits intomainfrom dev/data-source

+2,194-10

Commits on Feb 7, 2025

placeholder

sfc-gh-yuwang
authored and
sfc-gh-aling
committed
SNOW-1863392 :POC of python multi-process data ingestion (#2780 )

sfc-gh-yuwang
authored and
sfc-gh-aling
committed
SNOW-1887895 : setup num-workers and allow creating temp table and add unit test (#2896 )

sfc-gh-yuwang
authored and
sfc-gh-aling
committed
SNOW-1887892 : improve process pool + thread pool logic, add retry logic, add timeout logic (#2924 )

sfc-gh-yuwang
authored and
sfc-gh-aling
committed
SNOW-1887901 : fix partitioning logic (#2944 )

sfc-gh-yuwang
authored and
sfc-gh-aling
committed
SNOW-1848910 :source data to parquet to snowflake data type mapping (#2949 )

sfc-gh-yuwang
authored and
sfc-gh-aling
committed
SNOW-1887904 :add batch fetching logic (#2970 )

sfc-gh-yuwang
authored and
sfc-gh-aling
committed
SNOW-1904786 : add telemetry to data source dbapi (#2979 )
sfc-gh-aling
committed
SNOW-1916596 : fix conn execute, make implmentation function private (#2991 )
sfc-gh-aling
authored

Commits on Feb 11, 2025

SNOW-1887897 : [DataSource] add custom schema support (#2993 )
sfc-gh-aling
authored

Commits on Feb 14, 2025

SNOW-1893781 : support ingest oracle db (#2996 )
sfc-gh-yuwang
authored

Commits on Feb 18, 2025

SNOW-1903096 : add predicates (#3020 )

sfc-gh-yuwang
and
sfc-gh-jjiao
authored