Code

Add initial Arrow PyCapsule support#517

Code

Merged

jonmmease merged 23 commits intov2vega/vegafusion:v2from jonmmease/arrow-pycapsulevega/vegafusion:jonmmease/arrow-pycapsuleCopy head branch name to clipboardOct 15, 2024

+3,303-6,415

Commits

Commits on Oct 12, 2024

• Add initial Arrow PyCapsule support

  jonmmease

  committed
  9a09bdf

  Copy full SHA for 9a09bdf

• Bump python in actions to 3.11

  jonmmease

  committed
  bbfb563

  Copy full SHA for bbfb563

• fmt

  jonmmease

  committed
  c5652dc

  Copy full SHA for c5652dc

• update hang test to use polars with pycapsule path

  jonmmease

  committed
  6e83863

  Copy full SHA for 6e83863

• Add system python of 3.11

  jonmmease

  committed
  50c7163

  Copy full SHA for 50c7163

• Add more efficient hashing and rechunk for DataFusion

  jonmmease

  committed
  751af26

  Copy full SHA for 751af26

• fmt

  jonmmease

  committed
  8974fad

  Copy full SHA for 8974fad

• use narwhals to remove unused columns.

  jonmmease

  committed
  380de1e

  Copy full SHA for 380de1e

Commits on Oct 13, 2024

• toward removing arrow/pyarrow flag

  jonmmease

  committed
  67fb559

  Copy full SHA for 67fb559

• Remove arrow-rs pyarrow flag, use pyo3-arrow

  jonmmease

  committed
  b9bdf13

  Copy full SHA for b9bdf13

• Rename pyarrow feature flag to py

  jonmmease

  committed
  68b8324

  Copy full SHA for 68b8324

Commits on Oct 14, 2024

• toward using narwhals to process transformed data

  jonmmease

  committed
  80fd0da

  Copy full SHA for 80fd0da

• Remove python datasource

  jonmmease

  committed
  b9b65e1

  Copy full SHA for b9b65e1

• Handle dict and non-narwhals pycapsule types

  jonmmease

  committed
  57e5efc

  Copy full SHA for 57e5efc

• update default extraction to arro3

  jonmmease

  committed
  f9f7961

  Copy full SHA for f9f7961

• fix type checking

  jonmmease

  committed
  f27c7f7

  Copy full SHA for f27c7f7

• build py before type checking

  jonmmease

  committed
  7d8b9ca

  Copy full SHA for 7d8b9ca

• skip empty fields in window transform

  jonmmease

  committed
  47f675f

  Copy full SHA for 47f675f

Commits on Oct 15, 2024

• Try normalize category order

  jonmmease

  committed
  e029456

  Copy full SHA for e029456

• lower min Python back to 3.9

  jonmmease

  committed
  1dad584

  Copy full SHA for 1dad584

• clear wheel build dir first

  jonmmease

  committed
  9cefb4c

  Copy full SHA for 9cefb4c

• try rename artifacts

  jonmmease

  committed
  23efb08

  Copy full SHA for 23efb08

• cache?

  jonmmease

  committed
  56fa42a

  Copy full SHA for 56fa42a