I want to provide everyone with a quick update on the 0.12.0 release process. At this point, #2906 Fix Partition field IDs in table replacement <https://github.com/apache/iceberg/pull/2906> is the only remaining blocker. Ryan is working on a fix and predicts that we'll be ready to cut the first release candidate by the end of this week.
- Carl On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <szehon.apa...@gmail.com> wrote: > Hi Carl, > > For the Issue: https://github.com/apache/iceberg/issues/2783 > > The status is: I gave a bit of a try but couldn’t find an easy fix, so > hoping someone more knowledgable about this code has cycle to take a look > at it. > > It would be great to fix it for 0.12 as it seems to block more metadata > queries than before, but for timing purpose I’m not sure if its feasible. > > Thanks > Szehon > > On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <c...@apache.org> wrote: > >> Hi Everyone, >> >> Currently, there are three issues blocking the release of 0.12.0: >> >> >> 1. #2308 Handle the case that RewriteFiles and RowDelta commit the >> transaction at the same time >> <https://github.com/apache/iceberg/issues/2308> >> 2. #2783 Metadata Table Empty Projection - Unknown type for int >> field. Type name: java.lang.string >> <https://github.com/apache/iceberg/issues/2783> >> 3. #2284 Core: reassign the partition field IDs and reuse any >> existing ID <https://github.com/apache/iceberg/pull/2284>s >> >> #2284 is in review. >> >> Ryan said he would take a look at #2308. >> >> @Szehon Ho <sze...@cloudera.com>, can you please confirm whether or not >> you're working on #2783? >> >> Thanks. >> >> - Carl >> >> >> >> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <yezhao...@gmail.com> wrote: >> >>> I haven't heard any news for the 0.12.0 release since then, are we still >>> planning for the release? >>> >>> Please let me know if there is anything we can do to help speed up the >>> process. (I just saw the release board, will try to at least review those >>> PRs) >>> >>> Best, >>> Jack Ye >>> >>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati < >>> gsreeramku...@gmail.com> wrote: >>> >>>> Great, thanks Ryan. >>>> >>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <b...@tabular.io> wrote: >>>> >>>>> Sreeram, I was just waiting for tests to pass on that PR. I just >>>>> merged it. >>>>> >>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati < >>>>> gsreeramku...@gmail.com> wrote: >>>>> >>>>>> Hi Carl, >>>>>> >>>>>> Thanks a lot for managing 0.12.0 release. >>>>>> >>>>>> Can you also pl. add this PR: >>>>>> https://github.com/apache/iceberg/pull/2752 - which adds the option " >>>>>> streaming-skip-delete-snapshots" - to Spark3 micro_batch reader. >>>>>> Without this, streaming reads will fail if a snapshot of type delete or >>>>>> replace is encountered, & is pretty much unusable. This PR is already >>>>>> approved by multiple Committers - Ryan and Russell. >>>>>> >>>>>> PS: I am unsure if new PRs will be merged apart from the list >>>>>> proposed on the project board - into the *0.12.0* release, and >>>>>> hence, proposing this. If this PR will be merged - no action is needed. >>>>>> pl. >>>>>> pardon my ignorance. >>>>>> >>>>>> Best regards, >>>>>> Sreeram >>>>>> >>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <c...@tabular.io> >>>>>> wrote: >>>>>> >>>>>>> Hi Grant, >>>>>>> >>>>>>> Good catch! I added PR-1648 >>>>>>> <https://github.com/apache/iceberg/pull/1648> to the 0.12.0 project >>>>>>> board. >>>>>>> >>>>>>> - Carl >>>>>>> >>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas <gr...@spothero.com> >>>>>>> wrote: >>>>>>> >>>>>>>> Howdy! Any updates on PR-1648 >>>>>>>> <https://github.com/apache/iceberg/pull/1648> which upgrades the >>>>>>>> avro version used in iceberg? I do not see it in the "To-Do" section >>>>>>>> linked >>>>>>>> above, but the older avro version has caused major problems described >>>>>>>> in >>>>>>>> this issue and it would be nice to get in 0.12.0. >>>>>>>> https://github.com/apache/iceberg/issues/1654 >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach <c...@apache.org> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> Hi Everyone, >>>>>>>>> >>>>>>>>> >>>>>>>>> I volunteered to be the release manager for the 0.12.0 release. My >>>>>>>>> goal is to start cutting release candidates this Friday, 7/17 at >>>>>>>>> 24:00 PST. >>>>>>>>> I am tracking progress on this release on the Release 0.12.0 >>>>>>>>> Project Board <https://github.com/apache/iceberg/projects/1>. >>>>>>>>> Note that this board only tracks issues that BLOCK the release. >>>>>>>>> >>>>>>>>> >>>>>>>>> There are currently 7 PRs listed in the To-Do >>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627> >>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release >>>>>>>>> tomorrow, >>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following >>>>>>>>> information: >>>>>>>>> >>>>>>>>> >>>>>>>>> 1) Why does the PR need to be included in the 0.12.0 release? >>>>>>>>> >>>>>>>>> 2) When will the PR will be ready for review? >>>>>>>>> >>>>>>>>> >>>>>>>>> If you have any questions or concerns, please get in touch with me >>>>>>>>> over email or slack. >>>>>>>>> >>>>>>>>> >>>>>>>>> Thanks. >>>>>>>>> >>>>>>>>> >>>>>>>>> - Carl >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> >>>>>>>> [image: SpotHero] <http://spothero.com/> >>>>>>>> >>>>>>>> Grant Nicholas / Senior Data Engineer II >>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his >>>>>>>> gr...@spothero.com >>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn >>>>>>>> <https://www.linkedin.com/in/grantanicholas> >>>>>>>> *Your perfect spot is waiting for you! Learn more >>>>>>>> at spothero.com/careers <http://spothero.com/careers>* >>>>>>>> >>>>>>> >>>>> >>>>> -- >>>>> Ryan Blue >>>>> Tabular >>>>> >>>>
