Re: Capability to create table without reassigning IDs

2022-08-21 Thread Ryan Blue
Hi Raymond, One of the reasons why Iceberg doesn't currently support this is that it's dangerous to share files between tables. Even if you guarantee that a table has the same schema at some point in time, there's nothing stopping table schemas from diverging later. What are you trying to accompli

Re: Capability to create table without reassigning IDs

2022-08-21 Thread Ryan Blue
Can you expand on that a bit more? How is a table temporary if you intend to reuse its files in a different table? Is this something where you should be using `REPLACE TABLE ... AS SELECT` instead? On Sun, Aug 21, 2022 at 10:20 AM Walaa Eldin Moustafa < wmoust...@linkedin.com> wrote: > Thanks Rya

Welcome Fokko Driesprong as a committer!

2022-08-21 Thread Ryan Blue
Hi everyone, I would like to welcome Fokko Driesprong as a new committer to the project! Thanks for all your contributions, Fokko! Ryan -- Ryan Blue Tabular

Re: Welcome Fokko Driesprong as a committer!

2022-08-21 Thread Sam Redai
Huge congrats Fokko, well deserved! 🎉 On Sun, Aug 21, 2022 at 3:55 PM Ryan Blue wrote: > Hi everyone, > > I would like to welcome Fokko Driesprong as a new committer to the project! > > Thanks for all your contributions, Fokko! > > > Ryan > > -- > Ryan Blue > Tabular > -- Sam Redai Developer

Re: Welcome Fokko Driesprong as a committer!

2022-08-21 Thread Kyle Bendickson
Congratulations Fokko! This is indeed very well deserved! 🥳 It’s a pleasure to work with you! On Sun, Aug 21, 2022 at 12:57 PM Sam Redai wrote: > Huge congrats Fokko, well deserved! 🎉 > > On Sun, Aug 21, 2022 at 3:55 PM Ryan Blue wrote: > >> Hi everyone, >> >> I would like to welcome Fokko Dri

Re: Capability to create table without reassigning IDs

2022-08-21 Thread Vikram Bohra
Hi Ryan​ Expanding a bit more on the use case. The main table (non-temporary) is dual registered as both Hive and Iceberg tables. The main table location is used as the table location in the Hive case. Any new files need to be atomically added to this location to prevent read failures. A tempo

Re: Welcome Fokko Driesprong as a committer!

2022-08-21 Thread russell . spitzer
Congratulations! Sent from my iPhone > On Aug 21, 2022, at 3:00 PM, Kyle Bendickson wrote: > >  > Congratulations Fokko! This is indeed very well deserved! 🥳 > > It’s a pleasure to work with you! > >> On Sun, Aug 21, 2022 at 12:57 PM Sam Redai wrote: >> Huge congrats Fokko, well deserved!

Re: Welcome Fokko Driesprong as a committer!

2022-08-21 Thread Holden Karau
Congratulations 🍾 On Sun, Aug 21, 2022 at 1:57 PM wrote: > Congratulations! > > Sent from my iPhone > > On Aug 21, 2022, at 3:00 PM, Kyle Bendickson wrote: > >  > > Congratulations Fokko! This is indeed very well deserved! 🥳 > > It’s a pleasure to work with you! > > On Sun, Aug 21, 2022 at 12:

Re: Welcome Fokko Driesprong as a committer!

2022-08-21 Thread Austin Bennett
Thanks, for all you've done and will continue to do, Fokko! On Sun, Aug 21, 2022 at 2:10 PM Holden Karau wrote: > > Congratulations 🍾 > > On Sun, Aug 21, 2022 at 1:57 PM wrote: > >> Congratulations! >> >> Sent from my iPhone >> >> On Aug 21, 2022, at 3:00 PM, Kyle Bendickson wrote: >> >>  >>

Re: Welcome Fokko Driesprong as a committer!

2022-08-21 Thread Steven Wu
Congratulations and thanks for pushing the Python SDK! On Sun, Aug 21, 2022 at 2:18 PM Austin Bennett wrote: > Thanks, for all you've done and will continue to do, Fokko! > > On Sun, Aug 21, 2022 at 2:10 PM Holden Karau wrote: > >> >> Congratulations 🍾 >> >> On Sun, Aug 21, 2022 at 1:57 PM wro

Re: Welcome Fokko Driesprong as a committer!

2022-08-21 Thread Rajarshi Sarkar
Congratulations, Fokko! Regards, Rajarshi Sarkar On Mon, Aug 22, 2022 at 3:47 AM Steven Wu wrote: > Congratulations and thanks for pushing the Python SDK! > > On Sun, Aug 21, 2022 at 2:18 PM Austin Bennett < > whatwouldausti...@gmail.com> wrote: > >> Thanks, for all you've done and will contin

Re: Welcome Fokko Driesprong as a committer!

2022-08-21 Thread Jun H.
Congratulations, Fokko! On Sun, Aug 21, 2022 at 10:00 PM Rajarshi Sarkar wrote: > Congratulations, Fokko! > > Regards, > Rajarshi Sarkar > > > On Mon, Aug 22, 2022 at 3:47 AM Steven Wu wrote: > >> Congratulations and thanks for pushing the Python SDK! >> >> On Sun, Aug 21, 2022 at 2:18 PM Aus