Re: [DISCUSS] UUID type

2021-07-29 Thread Jacques Nadeau
It seems like Spark, Hive, Dremio and Impala all lack UUID as a native type. Which engines are you thinking of that have a native UUID type besides the Presto derivatives and support Iceberg? I agree that Trino should expose a UUID type on top of Iceberg tables. All the user experience things that

Re: [DISCUSS] Moving to apache-iceberg Slack workspace

2021-07-29 Thread Ryan Blue
Great, thanks for the help here! It sounds like there's consensus to move to the apache-iceberg community since the only responses have been positive so far. So let's plan on moving. Carl made me an admin, so I'll invite the other PMC members as admins and I'll also create an invite link that doe

Re: [DISCUSS] UUID type

2021-07-29 Thread Ryan Blue
I don't think this is just a problem in Trino. If there is no UUID type, then a user must choose between a 36-byte string and a 16-byte binary. That's not a good choice to force people into. If someone chooses binary, then it's harder to work with rows and construct queries even though there is a

Re: [DISCUSS] UUID type

2021-07-29 Thread Jacques Nadeau
I think points 1&2 don't really apply since a fixed width binary already covers those properties. It seems like this isn't really a concern of iceberg but rather a cosmetic layer that exists primarily (only?) in trino. In that case I would be inclined to say that trino should just use custom metad

Re: [DISCUSS] Moving to apache-iceberg Slack workspace

2021-07-29 Thread Piotr Findeisen
Hi, I was told the screenshot in my previous email doesn't show up, so sharing it as link instead https://gist.github.com/findepi/68e6a141d6ea06049c33e85c5ccd5835#gistcomment-3835460 Best PF On Thu, Jul 29, 2021 at 4:13 PM Piotr Findeisen wrote: > Hi, > > @Ryan Blue , where can one find at

Re: Proposal: Support for views in Iceberg

2021-07-29 Thread Piotr Findeisen
Hi Anjali, That's a nice summary. re dialect field. It shouldn't be a bit trouble to have it (or any other way to identify application that created the view), and it might be useful. Why not make it required from the start? re "expanded/resolved SQL" -- i don't understand yet what we would put t

Re: [DISCUSS] Moving to apache-iceberg Slack workspace

2021-07-29 Thread Piotr Findeisen
Hi, @Ryan Blue , where can one find at least a temporary signup link for apache-iceberg slack? Eduard, you can create a link that does not expire. You still need a new link every 2 thousand users joining. Below is an example what I see when creating a new invite link. [image: image.png] B

Re: [DISCUSS] Moving to apache-iceberg Slack workspace

2021-07-29 Thread Eduard Tudenhoefner
The default invite link expires after 30 days, that's why I was looking for alternatives. Maybe a slack admin can check if the invite link can be configured to not expire. On Thu, Jul 29, 2021, 11:51 Piotr Findeisen wrote: > Ryan, > > you should be able to create a semi-permanent invite link. >

Re: Proposal: Support for views in Iceberg

2021-07-29 Thread Anjali Norwood
Hi, Thank you for all the comments. I will try to address them all here together. - @all Cross engine compatibility of view definition: Multiple options such as engine agnostic SQL or IR of some form have been mentioned. We can all agree that all of these options are non-trivial to desi

Re: [DISCUSS] UUID type

2021-07-29 Thread Piotr Findeisen
Hi, I agree with Ryan, that it takes some precautions before one can assume uniqueness of UUID values, and that this shouldn't be any special for UUIDs at all. After all, this is just a primitive type, which is commonly used for certain things, but "commonly" doesn't mean "always". The advantages

Re: [DISCUSS] Moving to apache-iceberg Slack workspace

2021-07-29 Thread Piotr Findeisen
Ryan, you should be able to create a semi-permanent invite link. in Trino, we are almost successful with a static link (see https://trino.io/slack.html) admittedly they still break on some occasions (not very often). I would imagine a custom sign up form could have some issues from time to time a