Re: [DISCUSS] Content of Iceberg 1.1.0 release

[Gabor Kaszab]

Thanks for the quick answers, @Dmitri and @Ajantha!

Let's proceed then with the release creation. I'll start doing the
preparations and once I get to the point to make a cut I'll use the latest
git hash we have by that time. I heard that there are hiccups with the
snapshot versions  after the
1.0.0 release. I'll keep an eye on this as well but we can get the 1.1.0
release going anyway in my opinion.

Meanwhile, Fokko was open to help me out with the steps that require
committer privileges. Thanks, @Fokko!

Cheers,
Gabor



On Wed, Nov 2, 2022 at 3:23 PM Ajantha Bhat  wrote:

> 2) https://github.com/apache/iceberg/pull/4826
>> *@Ajantha* Similar question: you pinged me to put this into 1.1.0 but as
>> I see this has been ongoing since May. Do you feel this is going to be
>> merged soon?
>
>
> Yeah,
> Let's not block the 1.1.0 release because of it.
> I will follow up with the reviewers offline and try to get it merged at
> least for the next immediate release.
>
> Thanks,
> Ajantha
>
> On Wed, Nov 2, 2022 at 7:39 PM Dmitri Bourlatchkov <
> dmitri.bourlatch...@dremio.com> wrote:
>
>> > 1) https://github.com/apache/iceberg/issues/6031
>> *> @Dmitri* Could you please give us an update about this? Can we expect
>> this to be closed in the next - let's say - week?
>>
>> Next week looks too iffy to me at this point. Let's not block 1.1 on this.
>>
>> Cheers,
>> Dmitri.
>>
>> On Wed, Nov 2, 2022 at 10:01 AM Gabor Kaszab 
>> wrote:
>>
>>> Thanks for the inputs!
>>>
>>> @Yufei As I see #6026 was merged recently so this should be fine.
>>>
>>> There are 2 outstanding items targeted for 1.1.0:
>>> 1) https://github.com/apache/iceberg/issues/6031
>>> *@Dmitri* Could you please give us an update about this? Can we expect
>>> this to be closed in the next - let's say - week?
>>>
>>> 2) https://github.com/apache/iceberg/pull/4826
>>> *@Ajantha* Similar question: you pinged me to put this into 1.1.0 but
>>> as I see this has been ongoing since May. Do you feel this is going to be
>>> merged soon?
>>>
>>> *In general about the release frequency*:
>>> I asked around about the plan on how frequently we can expect a new
>>> Iceberg release from this point on and what I could learned is that the
>>> plan would be to have them quite often (once in a month or two?) but it's
>>> hard to say because this is going to be the first one after 1.0.0. We'll
>>> see how smoothly this and the next release goes.
>>> In general we shouldn't wait long for any specific patch and push
>>> everything unfinished to the next release considering there is going to be
>>> one soon after the current. Hope this makes sense.
>>>
>>> Cheers,
>>> Gabor
>>>
>>> On Sat, Oct 22, 2022 at 12:30 AM Yufei Gu  wrote:
>>>
 Hi Gabor,

 https://github.com/apache/iceberg/pull/6026 is fixing a bug
  in MOR vectorized
 read. We will need it in the new release.

 Best,

 Yufei

 `This is not a contribution`


 On Fri, Oct 21, 2022 at 9:26 AM Dmitri Bourlatchkov <
 dmitri.bourlatch...@dremio.com> wrote:

> #6031 is wide, but not all of that is needed to be able to use the new
> API in Iceberg :)
>
> ATM I'm thinking about 1 week for making client-side changes available
> in Nessie.
>
> How frequent are Iceberg releases going to be? If they are on the
> order of 1-2 weeks, then of course we can defer to a later point
> release but I hope not to delay for months :)
>
> Cheers,
> Dmitri.
>
> On Fri, Oct 21, 2022 at 11:52 AM Eduard Tudenhoefner <
> edu...@tabular.io> wrote:
>
>> @Dmitri: how close to completion is #6031? We're planning to release
>> more frequently than we have done in the past and 1.1.0 will contain the
>> latest changes from master btw.
>> I don't think we want to hold off too long with the release as there
>> are quite a big amount of new things that we'd like to ship. That's why 
>> I'm
>> curious whether #6031 is "almost" done? If it doesn't make it into 1.1.0,
>> then there will be a 1.2.0 release soonish as well.
>>
>> On Fri, Oct 21, 2022 at 4:55 PM Dmitri Bourlatchkov <
>> dmitri.bourlatch...@dremio.com> wrote:
>>
>>> I'd like to add https://github.com/apache/iceberg/issues/6031 to
>>> the 1.1 milestone (I believe permissions are indeed required for that).
>>>
>>> Most of the work will happen on the Nessie side. When the new API is
>>> ready, the expectation is that Iceberg will simply need to compile with 
>>> a
>>> new version of Nessie client jars (well, perhaps minor code changes may 
>>> be
>>> required).
>>>
>>> Thanks,
>>> Dmitri.
>>>
>>> On Fri, Oct 21, 2022 at 6:00 AM Gabor Kaszab 
>>> wrote:
>>>
 Hey Iceberg community,

 During the last community sync it came up that we might want to
>

Tableau Connectivity with Iceberg tables

[Agrawal, Sanket]

Hi,

I am trying to connect to Iceberg table saved in S3 through Tableau. Is there a 
way to connect to Iceberg tables through Tableau?

Thanks,
Sanket Agrawal

This message (including any attachments) contains confidential information 
intended for a specific individual and purpose, and is protected by law. If you 
are not the intended recipient, you should delete this message and any 
disclosure, copying, or distribution of this message, or the taking of any 
action based on it, by you is strictly prohibited.

Deloitte refers to a Deloitte member firm, one of its related entities, or 
Deloitte Touche Tohmatsu Limited ("DTTL"). Each Deloitte member firm is a 
separate legal entity and a member of DTTL. DTTL does not provide services to 
clients. Please see www.deloitte.com/about to learn more.

v.E.1

Re: Tableau Connectivity with Iceberg tables

[Dmitri Bourlatchkov]

Hi Sanket,

I do not have the full picture of tools that support both Iceberg and
Tableau, but Dremio, for example, does offer this connectivity.

https://docs.dremio.com/software/client-applications/tableau/

https://docs.dremio.com/software/data-formats/apache-iceberg/

Cheers,
Dmitri.

On Thu, Nov 3, 2022 at 9:22 AM Agrawal, Sanket
 wrote:

> Hi,
>
>
>
> I am trying to connect to Iceberg table saved in S3 through Tableau. Is
> there a way to connect to Iceberg tables through Tableau?
>
>
>
> Thanks,
>
> Sanket Agrawal
>
> This message (including any attachments) contains confidential information
> intended for a specific individual and purpose, and is protected by law. If
> you are not the intended recipient, you should delete this message and any
> disclosure, copying, or distribution of this message, or the taking of any
> action based on it, by you is strictly prohibited.
>
> Deloitte refers to a Deloitte member firm, one of its related entities, or
> Deloitte Touche Tohmatsu Limited ("DTTL"). Each Deloitte member firm is a
> separate legal entity and a member of DTTL. DTTL does not provide services
> to clients. Please see www.deloitte.com/about to learn more.
>
> v.E.1
>

Re: Tableau Connectivity with Iceberg tables

[Jean-Baptiste Onofré]

Hi

Agree. I’m not sure it’s possible to directly plug Tableau on top of
Iceberg tables.

Dremio provides data sources usable via Tableau.
I saw a demo showing that.

Regards
JB

Le jeu. 3 nov. 2022 à 18:59, Dmitri Bourlatchkov <
dmitri.bourlatch...@dremio.com> a écrit :

> Hi Sanket,
>
> I do not have the full picture of tools that support both Iceberg and
> Tableau, but Dremio, for example, does offer this connectivity.
>
> https://docs.dremio.com/software/client-applications/tableau/
>
> https://docs.dremio.com/software/data-formats/apache-iceberg/
>
> Cheers,
> Dmitri.
>
> On Thu, Nov 3, 2022 at 9:22 AM Agrawal, Sanket
>  wrote:
>
>> Hi,
>>
>>
>>
>> I am trying to connect to Iceberg table saved in S3 through Tableau. Is
>> there a way to connect to Iceberg tables through Tableau?
>>
>>
>>
>> Thanks,
>>
>> Sanket Agrawal
>>
>> This message (including any attachments) contains confidential
>> information intended for a specific individual and purpose, and is
>> protected by law. If you are not the intended recipient, you should delete
>> this message and any disclosure, copying, or distribution of this message,
>> or the taking of any action based on it, by you is strictly prohibited.
>>
>> Deloitte refers to a Deloitte member firm, one of its related entities,
>> or Deloitte Touche Tohmatsu Limited ("DTTL"). Each Deloitte member firm is
>> a separate legal entity and a member of DTTL. DTTL does not provide
>> services to clients. Please see www.deloitte.com/about to learn more.
>>
>> v.E.1
>>
>

Re: Tableau Connectivity with Iceberg tables

[Austin Bennett]

Use anything that Tableau can connect with, that in-turn can read Iceberg
Tables.

BigQuery can read Iceberg Tables:
https://cloud.google.com/blog/products/data-analytics/announcing-apache-iceberg-support-for-biglake

or

Athena:  https://docs.aws.amazon.com/athena/latest/ug/querying-iceberg.html

So, Tableau connects to {Athena, BigQuery, ... lots of other things,
Dremio, etc etc } which can read Iceberg Tables.


On Thu, Nov 3, 2022 at 11:10 AM Jean-Baptiste Onofré 
wrote:

> Hi
>
> Agree. I’m not sure it’s possible to directly plug Tableau on top of
> Iceberg tables.
>
> Dremio provides data sources usable via Tableau.
> I saw a demo showing that.
>
> Regards
> JB
>
> Le jeu. 3 nov. 2022 à 18:59, Dmitri Bourlatchkov <
> dmitri.bourlatch...@dremio.com> a écrit :
>
>> Hi Sanket,
>>
>> I do not have the full picture of tools that support both Iceberg and
>> Tableau, but Dremio, for example, does offer this connectivity.
>>
>> https://docs.dremio.com/software/client-applications/tableau/
>>
>> https://docs.dremio.com/software/data-formats/apache-iceberg/
>>
>> Cheers,
>> Dmitri.
>>
>> On Thu, Nov 3, 2022 at 9:22 AM Agrawal, Sanket
>>  wrote:
>>
>>> Hi,
>>>
>>>
>>>
>>> I am trying to connect to Iceberg table saved in S3 through Tableau. Is
>>> there a way to connect to Iceberg tables through Tableau?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Sanket Agrawal
>>>
>>> This message (including any attachments) contains confidential
>>> information intended for a specific individual and purpose, and is
>>> protected by law. If you are not the intended recipient, you should delete
>>> this message and any disclosure, copying, or distribution of this message,
>>> or the taking of any action based on it, by you is strictly prohibited.
>>>
>>> Deloitte refers to a Deloitte member firm, one of its related entities,
>>> or Deloitte Touche Tohmatsu Limited ("DTTL"). Each Deloitte member firm is
>>> a separate legal entity and a member of DTTL. DTTL does not provide
>>> services to clients. Please see www.deloitte.com/about to learn more.
>>>
>>> v.E.1
>>>
>>

RE: Tableau Connectivity with Iceberg tables

[Agrawal, Sanket]

Thank you everyone for quick responses. I will try these.

Thanks,
S. Agrawal

From: Austin Bennett 
Sent: Friday, November 4, 2022 1:46 AM
To: dev@iceberg.apache.org
Subject: [EXT] Re: Tableau Connectivity with Iceberg tables

Use anything that Tableau can connect with, that in-turn can read Iceberg 
Tables.

BigQuery can read Iceberg Tables:  
https://cloud.google.com/blog/products/data-analytics/announcing-apache-iceberg-support-for-biglake

or

Athena:  https://docs.aws.amazon.com/athena/latest/ug/querying-iceberg.html

So, Tableau connects to {Athena, BigQuery, ... lots of other things, Dremio, 
etc etc } which can read Iceberg Tables.


On Thu, Nov 3, 2022 at 11:10 AM Jean-Baptiste Onofré 
mailto:j...@nanthrax.net>> wrote:
Hi

Agree. I’m not sure it’s possible to directly plug Tableau on top of Iceberg 
tables.

Dremio provides data sources usable via Tableau.
I saw a demo showing that.

Regards
JB

Le jeu. 3 nov. 2022 à 18:59, Dmitri Bourlatchkov 
mailto:dmitri.bourlatch...@dremio.com>> a écrit 
:
Hi Sanket,

I do not have the full picture of tools that support both Iceberg and Tableau, 
but Dremio, for example, does offer this connectivity.

https://secure-web.cisco.com/1jCMUbGR6mnibfBOpjgtoEu7LdrjSgtd6DkvUmtbNLlbXoKTx7zObVFwSJsgckJcuTOc1uKTN11dsjWY_nT76prO9Wn6XAQRxnXnTt5S1ye6ur_z2mUS82m_srIdakoPasi9gw8hqRzxAi-PbBgq8tvAGZHEoHDFjiK7SrkC7YHdh46mawMOBj8qWNTC-BTa_Q-SOERzg32LOUzlZWCyHV2a7wSPOswoQiJxLYPwoiB4OnTJKmodvacbZI6htpT_KIwHgsaBrH7ex96bQNkxF6QXbcZaTM5ETIxq0SLFQXaWd9lDudlEXVrDAcoxNIdUl9TtreERq7NJDbLR25_AfP-HnOKhgUL-MjTgVgmGx8FuazEA42DcB4qgDlgAji_7xH-da124e-nQDE5_G-JH6ZZkdU5ABo0jhcPUUF5PQrhpQguspRw38AP4DHNwi4X_rVUE89qSRjBKPy90pw-LKbnftzqKYvncuYY91BBiOQwdMGnSBvh6S_YwTzI0ou1QbyKek-WuyNlCFZ1DRplo3Sg/https%3A%2F%2Fdocs.dremio.com%2Fsoftware%2Fclient-applications%2Ftableau%2F

https://secure-web.cisco.com/1V248EnG3ShueItuqHSK0d2U29N1HX7wW16kIQCsVy817yIpuCpY0XOHVEgiQtTrc4UH912l77hOLKBArU2lq4UsVgDbKbXeHQOQRnBA14BJxAYZlZF11gjTouPbGzeLWUuLNYzvAUmMUUpeOLp5a3_b0DGXTeNxaiCbhojRErGdDDFMdOZ-ef3wPv25ALq65t4KL8Wzbgx8GdYncVMoQC_CPYY6pQ7lR3t_LRvLpaqoWex-S82mqLa3IoWeywItpS7oO3D_q03pOxiSYlvtmxYxecdaD_UP3cex8SGi-uhg3aoKD7CuH8nFgeaaYK0j12MVe8kP8IfL6OrN6hYP9St9hDVUvSaP2CJPnLp-DsJ-3GTewqNwSxVMA_NtnJROnjPg_D3v-bDxdWMR6a-zwT0vqbfmtZ2wg1P8CL8i9w1OoXJiT7JMw4ZISAn9ddpmcU96PSSf4fyP8sqEmQgB-T6I_ywyzMLaK90YfbsGtVGQQVysAKAiDIbQlXweg8AEd_lNiruZYu6xemcspPtRJvA/https%3A%2F%2Fdocs.dremio.com%2Fsoftware%2Fdata-formats%2Fapache-iceberg%2F

Cheers,
Dmitri.

On Thu, Nov 3, 2022 at 9:22 AM Agrawal, Sanket 
mailto:sankeagra...@deloitte.com.invalid>> 
wrote:
Hi,

I am trying to connect to Iceberg table saved in S3 through Tableau. Is there a 
way to connect to Iceberg tables through Tableau?

Thanks,
Sanket Agrawal

This message (including any attachments) contains confidential information 
intended for a specific individual and purpose, and is protected by law. If you 
are not the intended recipient, you should delete this message and any 
disclosure, copying, or distribution of this message, or the taking of any 
action based on it, by you is strictly prohibited.

Deloitte refers to a Deloitte member firm, one of its related entities, or 
Deloitte Touche Tohmatsu Limited ("DTTL"). Each Deloitte member firm is a 
separate legal entity and a member of DTTL. DTTL does not provide services to 
clients. Please see www.deloitte.com/about to 
learn more.

v.E.1