Iceberg sync notes - 10 March 2021

Hey everyone, Thanks to folks who attended. I added my notes from the last sync. Please feel free to add/correct if I missed anything. Main points Highlights StreamingOffset for Structured Streaming in Spark New Actions API Spark procedure for partial import of existing tables Subsurface talks a

Re: Nessie PRs

Thanks for taking a look! Best, On Mon, Mar 15, 2021 at 7:36 PM Daniel Weeks wrote: > Looks like things are healthy again after just restarting the CI run. > Thanks for pointing that out Edgar! > > On Mon, Mar 15, 2021 at 1:39 PM Daniel Weeks wrote: > >> I saw a number of artifacts that looked

Re: Nessie PRs

Looks like things are healthy again after just restarting the CI run. Thanks for pointing that out Edgar! On Mon, Mar 15, 2021 at 1:39 PM Daniel Weeks wrote: > I saw a number of artifacts that looked unrelated to the change that > couldn't be resolved and assumed it was a temporary issue. > > I'

Re: Nessie PRs

I saw a number of artifacts that looked unrelated to the change that couldn't be resolved and assumed it was a temporary issue. I'll see if I can kick it off again (or Ryan M. if you have a chance to look at the error, that would help). On Mon, Mar 15, 2021 at 12:23 PM Edgar Rodriguez wrote: >

Re: Nessie PRs

FYI I think https://github.com/apache/iceberg/pull/2307 broke the CI, I'm seeing the following errors: FAILURE: Build failed with an exception. 29 30

Re: Nessie PRs

Thanks a lot Dan! On Mon, Mar 15, 2021 at 4:58 PM Daniel Weeks wrote: > Hey Ryan, I just took care of the first one and I might have some time to > look over the others today or tomorrow (unless someone else gets to them > first). > > -Dan > > On Mon, Mar 15, 2021 at 7:03 AM Ryan Murray wrote:

Re: Nessie PRs

Hey Ryan, I just took care of the first one and I might have some time to look over the others today or tomorrow (unless someone else gets to them first). -Dan On Mon, Mar 15, 2021 at 7:03 AM Ryan Murray wrote: > Hi All, > > I have a few Nessie PRs that I am hoping to try and get merged. Is th

Re: Migrating legacy snapshot daily Hive table concept to Iceberg

Hi Ryan, On Tue, Mar 9, 2021 at 5:54 AM Ryan Murray wrote: > Hey Edgar, Cheng Pan, > > I am not sure if you are aware of project nessie > ? It _may_ suit your needs. Nessie applies > git-like functionality to iceberg tables (in this case most useful are > branches and

Nessie PRs

Hi All, I have a few Nessie PRs that I am hoping to try and get merged. Is there a committer who has a bit of free time? Happy to help w/ some of the details if the PRs aren't clear. I am @rymurr on the apache slack if you want a quick response. The nessie version bump is the most pressing and th