Skip to content

Commit

Permalink
feat: Add Spark-compatible implementation of SchemaAdapterFactory (ap…
Browse files Browse the repository at this point in the history
…ache#1169)

* Add Spark-compatible SchemaAdapterFactory implementation

* remove prototype code

* fix

* refactor

* implement more cast logic

* implement more cast logic

* add basic test

* improve test

* cleanup

* fmt

* add support for casting unsigned int to signed int

* clippy

* address feedback

* fix test
  • Loading branch information
andygrove authored Dec 17, 2024
1 parent f69148d commit 7bd99f6
Show file tree
Hide file tree
Showing 6 changed files with 746 additions and 62 deletions.
4 changes: 3 additions & 1 deletion Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ arrow-buffer = { workspace = true }
arrow-data = { workspace = true }
arrow-schema = { workspace = true }
chrono = { workspace = true }
datafusion = { workspace = true }
datafusion = { workspace = true, features = ["parquet"] }
datafusion-common = { workspace = true }
datafusion-expr = { workspace = true }
datafusion-physical-expr = { workspace = true }
Expand All @@ -43,9 +43,11 @@ regex = { workspace = true }
thiserror = { workspace = true }
futures = { workspace = true }
twox-hash = "2.0.0"
rand = { workspace = true }

[dev-dependencies]
arrow-data = {workspace = true}
parquet = { workspace = true, features = ["arrow"] }
criterion = "0.5.1"
rand = { workspace = true}
tokio = { version = "1", features = ["rt-multi-thread"] }
Expand Down
Loading

0 comments on commit 7bd99f6

Please sign in to comment.