Iceberg docs pull requests

2023-07-14 Thread Zsolt Miskolczi
Hey team! First of all, thank you for giving us Iceberg. I really love the concept of how Iceberg structures the files and I'm pretty sure it is the feature of storing files in big data. However, the community is pretty active about developing Iceberg, I have a feeling that documentation doesn't

Re: Iceberg docs pull requests

2023-07-14 Thread Russell Spitzer
One of the issues is we kind of have a dual repo doc process. Most doc changes that are versioned are made in the main oss apache repo and they are copied over when Iceberg is released. So changes against the doc repo are only for fixing past docs or non-versioned pages. I'll take a quick look at

Re: Iceberg docs pull requests

2023-07-14 Thread Brian Olsen
I’m planning to propose a bunch of changes here. If you’re interested in discussing how you can help. Please join the Iceberg Slack and the channel #documentation. I would like to distribute work once some suggestions are accepted. I’m out of office today and early next week, but I’ll start work on

Gradle Version Catalog

2023-07-14 Thread Max Konstantinov
Hi Iceberg dev team! I'm sending this message to spread awareness of migration from the Nebula dependency recommender plugin to Gradle's versionCatalog using toml tile. You can get familiar with changes in this PR: https://github.com/apache/iceberg/pull/7694 Max.

Re: allowing configs to be specified in SQLConf for Spark reads/writes

2023-07-14 Thread Wing Yew Poon
I think that different use cases benefit from or even require different solutions. I think enabling options in Spark SQL is helpful, but allowing some configurations to be done in SQLConf is also helpful. For Cheng Pan's use case (to disable locality), I think providing a conf (which can be added t

Re: allowing configs to be specified in SQLConf for Spark reads/writes

2023-07-14 Thread Wing Yew Poon
Also, in the case of write mode (I mean write.delete.mode, write.update.mode, write.merge.mode), these cannot be set as options currently; they are only settable as table properties. On Fri, Jul 14, 2023 at 5:58 PM Wing Yew Poon wrote: > I think that different use cases benefit from or even requ

Re: [DISCUSS] Apache Iceberg Release 1.3.1

2023-07-14 Thread Szehon Ho
Thanks all for the interest and help. The last change we have on the 1.3.1 milestone is now merged, I will work on the release candidate and send a vote next week. Thanks Szehon On Wed, Jul 12, 2023 at 1:18 PM Fokko Driesprong wrote: > Hi Szehon, > > Thank you for the updates. I'm in favor of