Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: simplify expressions #3281

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

ion-elgreco
Copy link
Collaborator

Description

During merge we should simplify the expression before creating the commit predicate. Additionally, inside the DeltaScan we also need to simplify the expression to improve the pruning.

This doesn't fully fix it but discussing the issue here: apache/datafusion#14944

@github-actions github-actions bot added the binding/rust Issues for the Rust crate label Mar 1, 2025
@ion-elgreco ion-elgreco force-pushed the refactor--simplify-expressions-before-passing-them-around branch from d484c5a to 49f32db Compare March 1, 2025 11:45
@ion-elgreco ion-elgreco requested a review from fvaleye as a code owner March 1, 2025 11:45
@github-actions github-actions bot added the binding/python Issues for the Python package label Mar 1, 2025
Copy link

codecov bot commented Mar 1, 2025

Codecov Report

Attention: Patch coverage is 90.62500% with 3 lines in your changes missing coverage. Please review.

Project coverage is 72.13%. Comparing base (49ed2c8) to head (7a51022).

Files with missing lines Patch % Lines
crates/core/src/operations/merge/mod.rs 85.00% 1 Missing and 2 partials ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #3281      +/-   ##
==========================================
- Coverage   72.14%   72.13%   -0.01%     
==========================================
  Files         143      143              
  Lines       45624    45641      +17     
  Branches    45624    45641      +17     
==========================================
+ Hits        32915    32923       +8     
- Misses      10621    10625       +4     
- Partials     2088     2093       +5     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@ion-elgreco ion-elgreco force-pushed the refactor--simplify-expressions-before-passing-them-around branch from 49f32db to 7a51022 Compare March 1, 2025 11:53
@ion-elgreco ion-elgreco enabled auto-merge March 1, 2025 11:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
binding/python Issues for the Python package binding/rust Issues for the Rust crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant