Re: Iceberg transaction support with spark sql

2023-05-26 Thread Jack Ye
You can find example here: https://iceberg.apache.org/docs/latest/branching/#audit-branch -Jack On Fri, May 26, 2023 at 1:55 AM Gaurav Agarwal wrote: > Any examples nif these scenarios wap or branch and merge support > > On Fri, May 26, 2023, 3:14 AM Russell Spitzer > wrote: > >> We also have

Re: Iceberg transaction support with spark sql

2023-05-26 Thread Gaurav Agarwal
Any examples nif these scenarios wap or branch and merge support On Fri, May 26, 2023, 3:14 AM Russell Spitzer wrote: > We also have branch and merge support, which may be a bit easier to use > > > On May 25, 2023, at 4:33 PM, Anton Okolnychyi > wrote: > > > > Unfortunately, Spark SQL does not

Re: Iceberg transaction support with spark sql

2023-05-25 Thread Russell Spitzer
We also have branch and merge support, which may be a bit easier to use > On May 25, 2023, at 4:33 PM, Anton Okolnychyi > wrote: > > Unfortunately, Spark SQL does not have an API for transactions. However, you > may use Iceberg WAP to stage multiple changes and commit them as a single > Icebe

Re: Iceberg transaction support with spark sql

2023-05-25 Thread Anton Okolnychyi
Unfortunately, Spark SQL does not have an API for transactions. However, you may use Iceberg WAP to stage multiple changes and commit them as a single Iceberg transaction. - Anton > On May 25, 2023, at 12:49 PM, Gaurav Agarwal wrote: > > Hi > > We want to delete and insert rows in iceberg in

Iceberg transaction support with spark sql

2023-05-25 Thread Gaurav Agarwal
Hi We want to delete and insert rows in iceberg in one transaction and we are using spark SQL to execute delet e queries is there a way we can use it or implement in our application. I see somewhere dynamo db manager in your code will that help Thanks