Re: Append file and update properties in a single transaction

2020-12-07 Thread Omar Aloraini
Wow, Thanks a lot. I will try it tomorrow. 🙏🙏 On Mon, Dec 7, 2020, 9:25 PM Ryan Blue wrote: > Transactions do support property updates: > https://github.com/apache/iceberg/blob/master/core/src/main/java/org/apache/iceberg/BaseTransaction.java#L106-L111 > > The commit check is to ensure that the

Re: Append file and update properties in a single transaction

2020-12-07 Thread Ryan Blue
Transactions do support property updates: https://github.com/apache/iceberg/blob/master/core/src/main/java/org/apache/iceberg/BaseTransaction.java#L106-L111 The commit check is to ensure that the last operation was complete before adding a new operation. You need to call commit on each operation c

Re: Append file and update properties in a single transaction

2020-12-07 Thread Omar Aloraini
Hi Ryan, thanks for the reply, I can't recall the class name (will update you once I check), I think it was TransactionalTable, every method that modifies the table has a check weather the last part of a transaction (belonging to the same object created by table.newTransaction) was committed, i.e.

Re: Sync notes for 2 December 2020

2020-12-07 Thread Ryan Blue
Thanks for the note, Peter. No problem if it doesn't get done, that was just one that I thought we may want to include. Since we were unable to ask anyone actually working on it, we knew it was aspirational. We also know it could be a stretch to get the release out this year as well. Have a great h

Re: Append file and update properties in a single transaction

2020-12-07 Thread Ryan Blue
Omar, You can append files and update properties. You just need to create a transaction using `newTransaction` in the `Table` API. rb On Sun, Dec 6, 2020 at 7:16 AM Omar Aloraini wrote: > Hello everyone, > > I'm trying to append new files and update the table properties in single > transaction

Re: Shall we start a regular community sync up?

2020-12-07 Thread Guy Khazma
Hi, I will be glad to get an invitation as well. Thanks! On 2020/12/01 19:23:14, Russell Spitzer wrote: > Invite sent > > On Tue, Dec 1, 2020 at 1:20 PM Wing Yew Poon > wrote: > > > I'd like to attend the community syncs as well. Can you please send me an > > invite? > > Thanks, > > Wing Yew

Re: Iceberg/Hive properties handling

2020-12-07 Thread Jacques Nadeau
Hey Peter, thanks for updating the doc and your heads up in the other thread on your capacity to look at this before EOY. I'm going to try to create a specification document based on the discussion document you put together. I think there is general consensus around what you call "Spark-like catal

Re: Sync notes for 2 December 2020

2020-12-07 Thread Peter Vary
Hi Team, I will be OOO starting from the end of this week. If someone wants to pick up Hive config changes, feel free to grab it. I am afraid I will not have enough time to do it this year. Thanks, Peter > On Dec 5, 2020, at 02:13, Ryan Blue wrote: > > Hi everyone, > > I just wrote up my no