Thanks for the reply Robert – I will try out #1 & keep you posted.
From: Robert Metzger
Date: Wednesday, May 24, 2017 at 7:44 AM
To: "Jain, Ankit"
Cc: "user@flink.apache.org"
Subject: Re: High Availability on Yarn
Hi Ankit,
I realized I can answer your questions myse
From: *"Jain, Ankit"
>> *Date: *Tuesday, May 16, 2017 at 12:14 AM
>>
>> *To: *Stephan Ewen , "user@flink.apache.org" <
>> user@flink.apache.org>
>> *Subject: *Re: High Availability on Yarn
>>
>>
>>
>> Bringing it back to list’
*To: *Stephan Ewen , "user@flink.apache.org" <
> user@flink.apache.org>
> *Subject: *Re: High Availability on Yarn
>
>
>
> Bringing it back to list’s focus.
>
>
>
> *From: *"Jain, Ankit"
> *Date: *Thursday, May 11, 2017 at 1:19 PM
> *To: *St
Following up on this.
From: "Jain, Ankit"
Date: Tuesday, May 16, 2017 at 12:14 AM
To: Stephan Ewen , "user@flink.apache.org"
Subject: Re: High Availability on Yarn
Bringing it back to list’s focus.
From: "Jain, Ankit"
Date: Thursday, May 11, 2017 at 1:
Bringing it back to list’s focus.
From: "Jain, Ankit"
Date: Thursday, May 11, 2017 at 1:19 PM
To: Stephan Ewen , "user@flink.apache.org"
Subject: Re: High Availability on Yarn
Got the answer on #2, looks like that will work, still looking for suggestions
on #1.
Thank
Got the answer on #2, looks like that will work, still looking for suggestions
on #1.
Thanks
Ankit
From: "Jain, Ankit"
Date: Thursday, May 11, 2017 at 8:26 AM
To: Stephan Ewen , "user@flink.apache.org"
Subject: Re: High Availability on Yarn
Following up further on th
9:09 AM
To: Stephan Ewen , "user@flink.apache.org"
Subject: Re: High Availability on Yarn
Thanks Stephan – we will go with a central ZooKeeper Instance and hopefully
have it started through a cloudformation script as part of EMR startup.
Is Zk also used to keep track of checkpoint metada
Aljoscha was
guessing below or only for leader election in case of accidently running
multiple Application Masters ?
Thanks
Ankit
From: Stephan Ewen
Date: Monday, May 8, 2017 at 9:00 AM
To: "user@flink.apache.org" , "Jain, Ankit"
Subject: Re: High Availability on Yarn
@
9 AM
> *To: *"Jain, Ankit"
> *Cc: *"user@flink.apache.org" , Till Rohrmann <
> trohrm...@apache.org>
> *Subject: *Re: High Availability on Yarn
>
> Hi,
> Yes, for YARN there is only one running JobManager. As far as I Know, In
> this case ZooKeeper is only u
stance per flink job?
>
> Thanks
> Ankit
>
> From: Aljoscha Krettek
> Date: Thursday, May 4, 2017 at 1:19 AM
> To: "Jain, Ankit"
> Cc: "user@flink.apache.org" , Till Rohrmann
>
> Subject: Re: High Availability on Yarn
>
> Hi,
> Yes, for Y
keeper instance for ALL of flink jobs?
Or
Recommendation is to have a dedicated Zookeeper instance per flink job?
Thanks
Ankit
From: Aljoscha Krettek
Date: Thursday, May 4, 2017 at 1:19 AM
To: "Jain, Ankit"
Cc: "user@flink.apache.org" , Till Rohrmann
Subject: Re: High Availabi
kit"
> Cc: "user@flink.apache.org" , Till Rohrmann
>
> Subject: Re: High Availability on Yarn
>
> Hi,
> As a first comment, the work mentioned in the FLIP-6 doc you linked is still
> work-in-progress. You cannot use these abstractions yet without going i
nkit
From: Aljoscha Krettek
Date: Wednesday, May 3, 2017 at 2:05 AM
To: "Jain, Ankit"
Cc: "user@flink.apache.org" , Till Rohrmann
Subject: Re: High Availability on Yarn
Hi,
As a first comment, the work mentioned in the FLIP-6 doc you linked is still
work-in-progre
Hi,
As a first comment, the work mentioned in the FLIP-6 doc you linked is still
work-in-progress. You cannot use these abstractions yet without going into the
code and setting up a cluster “by hand”.
The documentation for one-step deployment of a Job to YARN is available here:
https://ci.apach
Hi fellow users,
We are trying to straighten out high availability story for flink.
Our setup includes a long running EMR cluster, job submission is a two-step
process – 1) Flink cluster is first created using flink yarn client on the EMR
cluster already running 2) Flink job is submitted.
I als
15 matches
Mail list logo
