___
From: Yang Wang mailto:danrtsey...@gmail.com>>
Sent: Wednesday, September 2, 2020 8:21:20 PM
To: Alexey Trenikhun mailto:yen...@msn.com>>
Cc: dev mailto:d...@flink.apache.org>>; Flink User Mail
List mailto:user@flink.apache.org>>
Subject: Re: FileSystemHaServic
-
> *From:* Yang Wang
> *Sent:* Wednesday, September 2, 2020 8:21:20 PM
> *To:* Alexey Trenikhun
> *Cc:* dev ; Flink User Mail List <
> user@flink.apache.org>
> *Subject:* Re: FileSystemHaServices and BlobStore
>
> Hi Alexey,
>
> Thanks for the feedback.
: FileSystemHaServices and BlobStore
Hi Alexey,
Thanks for the feedback. You are right. StatefulSet + PersistentVolume +
FileSystemHaService could be another
bundle of services for Flink HA support on K8s. The user jars could be built
into the image or downloaded by init-container
or mount via the PV. So they do
>
> Thanks,
> Alexey
>
> --
> *From:* Yang Wang
> *Sent:* Tuesday, September 1, 2020 1:58 AM
> *To:* dev
> *Cc:* Alexey Trenikhun ; Flink User Mail List <
> user@flink.apache.org>
> *Subject:* Re: FileSystemHaServices and BlobStore
>
>
from failure even
VoidBlobStore. I also use StatefulSet instead of Deployment
Thanks,
Alexey
From: Yang Wang
Sent: Tuesday, September 1, 2020 1:58 AM
To: dev
Cc: Alexey Trenikhun ; Flink User Mail List
Subject: Re: FileSystemHaServices and BlobStore
Hi Alexey,
Gl
able to recover from both JM restart and
> > TM restart. Any idea in what use cases HA Blob is needed?
> >
> > Thanks,
> > Alexey
> > --
> > *From:* Alexey Trenikhun
> > *Sent:* Friday, August 28, 2020 11:31 AM
> > *T
gt; Thanks,
> Alexey
> --
> *From:* Alexey Trenikhun
> *Sent:* Friday, August 28, 2020 11:31 AM
> *To:* Khachatryan Roman
> *Cc:* Flink User Mail List
> *Subject:* Re: FileSystemHaServices and BlobStore
>
> Motivation is to have k8s HA setup without extra component - Zookeep
, August 28, 2020 11:31 AM
To: Khachatryan Roman
Cc: Flink User Mail List
Subject: Re: FileSystemHaServices and BlobStore
Motivation is to have k8s HA setup without extra component - Zookeeper, see [1]
Purpose of BlobStore is vague to me, what kind of BLOBs are stored? Looks like
if we start job from
,
Alexey
[1]. https://issues.apache.org/jira/browse/FLINK-17598
From: Khachatryan Roman
Sent: Friday, August 28, 2020 9:24 AM
To: Alexey Trenikhun
Cc: Flink User Mail List
Subject: Re: FileSystemHaServices and BlobStore
Hello Alexey,
I think you need
Hello Alexey,
I think you need FileSystemBlobStore as you are implementing HA Services,
and BLOBs should be highly available too.
However, I'm a bit concerned about the direction in general: it essentially
means re-implementing ZK functionality on top of FS.
What are the motivation and the use cas
Hello,
I'm thinking about implementing FileSystemHaServices - single leader, but
persistent RunningJobRegistry, CheckpointIDCounter, CompletedCheckpointStore
and JobGraphStore. I'm not sure do you need FileSystemBlobStore or
VoidBlobStore is enough. Can't figure out, should BlobStore survive Job
11 matches
Mail list logo
