Update: still waiting for a +1 on the release notes https://github.com/apache/iceberg/pull/2973
- Carl On Sat, Aug 14, 2021 at 6:25 PM Carl Steinbach <c...@apache.org> wrote: > The 0.12.0 release has been approved, but before we can announce it we > need to add the release notes. > > Please help us get over this hurdle by reviewing the release notes draft > here: https://github.com/apache/iceberg/pull/2973 > > Thanks! > > - Carl > > On Tue, Aug 3, 2021 at 4:46 PM Carl Steinbach <c...@tabular.io> wrote: > >> Thanks, Jack and Ryan, for closing out these issues. Since there are no >> more blockers, I will start preparing a release candidate. >> >> - Carl >> >> On Tue, Aug 3, 2021 at 3:29 PM Ryan Blue <b...@tabular.io> wrote: >> >>> I just merged the PR. Thanks for making it possible to create v2 tables >>> easily, Jack! >>> >>> On Tue, Aug 3, 2021 at 1:02 PM Jack Ye <yezhao...@gmail.com> wrote: >>> >>>> Thanks! The PR is mostly ready and just got approved by Anton. As soon >>>> as it is merged we can start the branch cut. >>>> -Jack >>>> >>>> On Mon, Aug 2, 2021 at 11:39 PM Carl Steinbach <cwsteinb...@gmail.com> >>>> wrote: >>>> >>>>> Hi Jack, >>>>> >>>>> I added #2887 to the 0.12.0 release project board >>>>> <https://github.com/apache/iceberg/projects/1>. When do you think >>>>> this patch will be committed? >>>>> >>>>> - Carl >>>>> >>>>> On Mon, Aug 2, 2021 at 4:28 PM Ryan Blue <b...@tabular.io> wrote: >>>>> >>>>>> Jack, I've been reviewing that one so that we can get it in. Thanks >>>>>> for fixing it! >>>>>> >>>>>> On Mon, Aug 2, 2021 at 3:12 PM Jack Ye <yezhao...@gmail.com> wrote: >>>>>> >>>>>>> Thanks for the update Carl! >>>>>>> >>>>>>> Given that we have voted for the adoption of format v2, can we also >>>>>>> get this change in, so that people can start to use v2 tables? >>>>>>> https://github.com/apache/iceberg/pull/2887 >>>>>>> >>>>>>> -Jack >>>>>>> >>>>>>> On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach <c...@apache.org> >>>>>>> wrote: >>>>>>> >>>>>>>> I want to provide everyone with a quick update on the 0.12.0 >>>>>>>> release process. At this point, #2906 Fix Partition field IDs in >>>>>>>> table replacement <https://github.com/apache/iceberg/pull/2906> is >>>>>>>> the only remaining blocker. Ryan is working on a fix and predicts that >>>>>>>> we'll be ready to cut the first release candidate by the end of this >>>>>>>> week. >>>>>>>> >>>>>>>> - Carl >>>>>>>> >>>>>>>> On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <szehon.apa...@gmail.com> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> Hi Carl, >>>>>>>>> >>>>>>>>> For the Issue: https://github.com/apache/iceberg/issues/2783 >>>>>>>>> >>>>>>>>> The status is: I gave a bit of a try but couldn’t find an easy >>>>>>>>> fix, so hoping someone more knowledgable about this code has cycle to >>>>>>>>> take >>>>>>>>> a look at it. >>>>>>>>> >>>>>>>>> It would be great to fix it for 0.12 as it seems to block more >>>>>>>>> metadata queries than before, but for timing purpose I’m not sure if >>>>>>>>> its >>>>>>>>> feasible. >>>>>>>>> >>>>>>>>> Thanks >>>>>>>>> Szehon >>>>>>>>> >>>>>>>>> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <c...@apache.org> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> Hi Everyone, >>>>>>>>>> >>>>>>>>>> Currently, there are three issues blocking the release of 0.12.0: >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> 1. #2308 Handle the case that RewriteFiles and RowDelta >>>>>>>>>> commit the transaction at the same time >>>>>>>>>> <https://github.com/apache/iceberg/issues/2308> >>>>>>>>>> 2. #2783 Metadata Table Empty Projection - Unknown type for >>>>>>>>>> int field. Type name: java.lang.string >>>>>>>>>> <https://github.com/apache/iceberg/issues/2783> >>>>>>>>>> 3. #2284 Core: reassign the partition field IDs and reuse any >>>>>>>>>> existing ID <https://github.com/apache/iceberg/pull/2284>s >>>>>>>>>> >>>>>>>>>> #2284 is in review. >>>>>>>>>> >>>>>>>>>> Ryan said he would take a look at #2308. >>>>>>>>>> >>>>>>>>>> @Szehon Ho <sze...@cloudera.com>, can you please confirm whether >>>>>>>>>> or not you're working on #2783? >>>>>>>>>> >>>>>>>>>> Thanks. >>>>>>>>>> >>>>>>>>>> - Carl >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <yezhao...@gmail.com> >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>>> I haven't heard any news for the 0.12.0 release since then, are >>>>>>>>>>> we still planning for the release? >>>>>>>>>>> >>>>>>>>>>> Please let me know if there is anything we can do to help speed >>>>>>>>>>> up the process. (I just saw the release board, will try to at least >>>>>>>>>>> review >>>>>>>>>>> those PRs) >>>>>>>>>>> >>>>>>>>>>> Best, >>>>>>>>>>> Jack Ye >>>>>>>>>>> >>>>>>>>>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati < >>>>>>>>>>> gsreeramku...@gmail.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> Great, thanks Ryan. >>>>>>>>>>>> >>>>>>>>>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <b...@tabular.io> >>>>>>>>>>>> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Sreeram, I was just waiting for tests to pass on that PR. I >>>>>>>>>>>>> just merged it. >>>>>>>>>>>>> >>>>>>>>>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati < >>>>>>>>>>>>> gsreeramku...@gmail.com> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Hi Carl, >>>>>>>>>>>>>> >>>>>>>>>>>>>> Thanks a lot for managing 0.12.0 release. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Can you also pl. add this PR: >>>>>>>>>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds the >>>>>>>>>>>>>> option "streaming-skip-delete-snapshots" - to Spark3 >>>>>>>>>>>>>> micro_batch reader. Without this, streaming reads will fail if a >>>>>>>>>>>>>> snapshot >>>>>>>>>>>>>> of type delete or replace is encountered, & is pretty much >>>>>>>>>>>>>> unusable. This >>>>>>>>>>>>>> PR is already approved by multiple Committers - Ryan and Russell. >>>>>>>>>>>>>> >>>>>>>>>>>>>> PS: I am unsure if new PRs will be merged apart from the list >>>>>>>>>>>>>> proposed on the project board - into the *0.12.0* release, >>>>>>>>>>>>>> and hence, proposing this. If this PR will be merged - no action >>>>>>>>>>>>>> is needed. >>>>>>>>>>>>>> pl. pardon my ignorance. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Best regards, >>>>>>>>>>>>>> Sreeram >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach < >>>>>>>>>>>>>> c...@tabular.io> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Hi Grant, >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Good catch! I added PR-1648 >>>>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the 0.12.0 >>>>>>>>>>>>>>> project board. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> - Carl >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas < >>>>>>>>>>>>>>> gr...@spothero.com> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Howdy! Any updates on PR-1648 >>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which >>>>>>>>>>>>>>>> upgrades the avro version used in iceberg? I do not see it in >>>>>>>>>>>>>>>> the "To-Do" >>>>>>>>>>>>>>>> section linked above, but the older avro version has caused >>>>>>>>>>>>>>>> major problems >>>>>>>>>>>>>>>> described in this issue and it would be nice to get in 0.12.0. >>>>>>>>>>>>>>>> https://github.com/apache/iceberg/issues/1654 >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach < >>>>>>>>>>>>>>>> c...@apache.org> wrote: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Hi Everyone, >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> I volunteered to be the release manager for the 0.12.0 >>>>>>>>>>>>>>>>> release. My goal is to start cutting release candidates this >>>>>>>>>>>>>>>>> Friday, 7/17 >>>>>>>>>>>>>>>>> at 24:00 PST. I am tracking progress on this release on the >>>>>>>>>>>>>>>>> Release >>>>>>>>>>>>>>>>> 0.12.0 Project Board >>>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1>. Note that >>>>>>>>>>>>>>>>> this board only tracks issues that BLOCK the release. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> There are currently 7 PRs listed in the To-Do >>>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627> >>>>>>>>>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 >>>>>>>>>>>>>>>>> release tomorrow, >>>>>>>>>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following >>>>>>>>>>>>>>>>> information: >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0 >>>>>>>>>>>>>>>>> release? >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> 2) When will the PR will be ready for review? >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> If you have any questions or concerns, please get in touch >>>>>>>>>>>>>>>>> with me over email or slack. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Thanks. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> - Carl >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> [image: SpotHero] <http://spothero.com/> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Grant Nicholas / Senior Data Engineer II >>>>>>>>>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his >>>>>>>>>>>>>>>> gr...@spothero.com >>>>>>>>>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn >>>>>>>>>>>>>>>> <https://www.linkedin.com/in/grantanicholas> >>>>>>>>>>>>>>>> *Your perfect spot is waiting for you! Learn more >>>>>>>>>>>>>>>> at spothero.com/careers <http://spothero.com/careers>* >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>>> Ryan Blue >>>>>>>>>>>>> Tabular >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>> >>>>>> -- >>>>>> Ryan Blue >>>>>> Tabular >>>>>> >>>>> >>> >>> -- >>> Ryan Blue >>> Tabular >>> >>
