Native Iceberg Support

[sh-rp]

Feature description

Iceberg support with py-iceberg to support multiple bucket hoster and query engines.

Are you a dlt user?

Yes, I'm already a dlt user.

Use case

No response

Proposed solution

No response

Related issues

No response

[btelFD]

Would love that!

[shohamyamin]

@sh-rp any update on that feature?

[sh-rp]

@shohamyamin right now we are not working on this, but we have support for delta tables now which might also work for some users :)

[mike-luabase]

I'm guessing you'd need / want partitioned writes which should be released in 0.7.0 apache/iceberg-python#208

[thenaturalist]

@sh-rp any update on this?

Given the importance placed on openness and portability, Apache Iceberg has a considerably more open and less Databricks dependent history and ecosystem, so should be more well aligned with dlt's values and vision?

[tusharchou]

Hey I can help contribute here!