Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] support iceberg compaction #6206

Open
melin opened this issue Jan 13, 2025 · 3 comments
Open

[FEATURE] support iceberg compaction #6206

melin opened this issue Jan 13, 2025 · 3 comments
Labels
feature New feature or request

Comments

@melin
Copy link

melin commented Jan 13, 2025

Describe the feature

support iceberg compact

https://aws.amazon.com/cn/blogs/aws/aws-glue-data-catalog-now-supports-automatic-compaction-of-apache-iceberg-tables/

Motivation

No response

Describe the solution

No response

Additional context

No response

@melin melin added the feature New feature or request label Jan 13, 2025
@FANNG1
Copy link
Contributor

FANNG1 commented Jan 13, 2025

Hi, @melin , thanks for proposing this, could you share your scenarios for requesting the compaction feature for Gravitino?

@melin melin changed the title [FEATURE] support iceberg compact [FEATURE] support iceberg compaction Jan 13, 2025
@melin
Copy link
Author

melin commented Jan 13, 2025

Hi, @melin , thanks for proposing this, could you share your scenarios for requesting the compaction feature for Gravitino?

support automatic compaction of Apache Iceberg tables, making it easier for you to keep your transactional data lakes always performant. automatic compaction on Apache Iceberg tables reduces metadata overhead on your Iceberg tables and improves query performance.

ref: https://aws.amazon.com/about-aws/whats-new/2023/11/aws-glue-data-catalog-compaction-iceberg-tables/?nc1=h_ls

@sunxiaojian
Copy link
Contributor

The compaction feature of Iceberg itself should also be able to meet this requirement, right?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants