Re: Is it possible to get Flink job name in an operator?

2019-10-15 Thread Aleksandar Mastilovic
I got mine in AbstractStreamOperator.open() method through this.getContainingTask().getEnvironment().getJobID(); > On Oct 14, 2019, at 11:53 PM, 马阳阳 wrote: > > As the title. Is it possible now? Or if we can do something to achieve this. > I tried to put the job name into the ExecutionConfig.G

Re: Problem with savepoint deserialization

2019-10-08 Thread Aleksandar Mastilovic
schema during restore. > > Sent from my iPhone > > On Oct 8, 2019, at 1:22 PM, Aleksandar Mastilovic > mailto:amastilo...@sightmachine.com>> wrote: > >> The Option class is not serializable, if you put something serializable into >> that case class you wouldn’t

Re: Problem with savepoint deserialization

2019-10-08 Thread Aleksandar Mastilovic
The Option class is not serializable, if you put something serializable into that case class you wouldn’t have problems. > On Oct 8, 2019, at 8:17 AM, Steven Nelson wrote: > > Hello! We are working with a Scala based pipeline. > > We changed > > case class Record(orgId: Int) > > To > > cas

Re: Challenges Deploying Flink With Savepoints On Kubernetes

2019-09-25 Thread Aleksandar Mastilovic
ira/browse/FLINK-11105 > <https://issues.apache.org/jira/browse/FLINK-11105> > [2] https://issues.apache.org/jira/browse/FLINK-12884 > <https://issues.apache.org/jira/browse/FLINK-12884> > > Best > Yun Tang > From: Aleksandar Mastilovic > Sent: Thursday, Septem

Re: Challenges Deploying Flink With Savepoints On Kubernetes

2019-09-25 Thread Aleksandar Mastilovic
Can’t you simply use JobManager in HA mode? It would pick up where it left off if you don’t provide a Savepoint. > On Sep 25, 2019, at 6:07 AM, Sean Hester wrote: > > thanks for all replies! i'll definitely take a look at the Flink k8s Operator > project. > > i'll try to restate the issue to

Re: [SURVEY] How do you use high-availability services in Flink?

2019-09-03 Thread Aleksandar Mastilovic
ilesystem > and just store a handle in MapDB? > > Best, > tison. > > > Aleksandar Mastilovic <mailto:amastilo...@sightmachine.com>> 于2019年8月24日周六 上午7:04写道: > Hi all, > > Since I’m currently working on an implementation of > HighAvailabilityServicesFactory I

Re: [SURVEY] How do you use high-availability services in Flink?

2019-08-23 Thread Aleksandar Mastilovic
a JobManager and bringing it back up does indeed restore all the running jobs. Job creation/destruction also works. Hope this helps! Thanks, Aleksandar Mastilovic > On Aug 21, 2019, at 12:32 AM, Zili Chen wrote: > > Hi guys, > > We want to have an accurate idea of how

Re: TaskManager not connecting to ResourceManager in HA mode

2019-08-22 Thread Aleksandar Mastilovic
HA services. > Would you check whether your customized HA services is returning the right > LeaderRetrievalService and whether the LeaderRetrievalService is really > retrieving the right leader's address? > Or is it possible that the stored resource manager address in HA is rep

TaskManager not connecting to ResourceManager in HA mode

2019-08-21 Thread Aleksandar Mastilovic
/jobmanager, retrying in 1 ms: Could not connect to rpc endpoint under address akka.tcp://flink@jobmanager:6123/user/jobmanager.. Is this a known bug? I’d appreciate any help I can get. Thanks, Aleksandar Mastilovic

Re: How can I pass multiple java options in standalone mode ?

2019-08-14 Thread Aleksandar Mastilovic
It’s a YAML file, so I think you need to do something like env.java.opts: -Dconfig.resource=qa.conf > On Aug 14, 2019, at 11:58 AM, Vishwas Siravara wrote: > > When I add env.java.opts like this > env.java.opts:"-Dconfig.resource=qa.conf" > > I see an error in the log file saying : - Error