Re: Connecting workflows in batch

2017-03-08 Thread Shannon Carey
ult you're definitely not able to use any JobExecutionResult in your main method, even though the code makes it looks like you will. -Shannon From: Aljoscha Krettek mailto:aljos...@apache.org>> Date: Friday, March 3, 2017 at 9:36 AM To: mailto:user@flink.apache.org>> Subject: Re: Co

Re: Connecting workflows in batch

2017-03-03 Thread Aljoscha Krettek
Yes, right now that call never returns for a long-running streaming job. We will (in the future) provide a way for that call to return so that the result can be used for checking aggregators and other things. On Thu, Mar 2, 2017, at 19:14, Mohit Anchlia wrote: > Does it mean that for streaming

Re: Connecting workflows in batch

2017-03-02 Thread Mohit Anchlia
Does it mean that for streaming jobs it never returns? On Thu, Mar 2, 2017 at 6:21 AM, Till Rohrmann wrote: > Hi Mohit, > > StreamExecutionEnvironment.execute() will only return giving you the > JobExecutionResult after the job has reached a final stage. If that works > for you to schedule the s

Re: Connecting workflows in batch

2017-03-02 Thread Till Rohrmann
Hi Mohit, StreamExecutionEnvironment.execute() will only return giving you the JobExecutionResult after the job has reached a final stage. If that works for you to schedule the second job, then it should be ok to combine both jobs in one program and execute the second job after the first one has c

Re: Connecting workflows in batch

2017-03-01 Thread Mohit Anchlia
It looks like JobExecutionResult can be used here by using the accumulators? On Wed, Mar 1, 2017 at 8:37 AM, Aljoscha Krettek wrote: > I think right now the best option is the JobManager REST interface: > https://ci.apache.org/projects/flink/flink-docs- > release-1.3/monitoring/rest_api.html > >

Re: Connecting workflows in batch

2017-03-01 Thread Aljoscha Krettek
I think right now the best option is the JobManager REST interface: https://ci.apache.org/projects/flink/flink-docs-release-1.3/monitoring/rest_api.html You would have to know the ID of your job and then you can poll the status of your running jobs. On Mon, 27 Feb 2017 at 18:15 Mohit Anchlia wro

Re: Connecting workflows in batch

2017-02-27 Thread Mohit Anchlia
What's the best way to track the progress of the job? On Mon, Feb 27, 2017 at 7:56 AM, Aljoscha Krettek wrote: > Hi Mohit, > I'm afraid there is nothing like this in Flink yet. As you mentioned you > probably have to manually track the completion of one job and then trigger > execution of the ne

Re: Connecting workflows in batch

2017-02-27 Thread Aljoscha Krettek
Hi Mohit, I'm afraid there is nothing like this in Flink yet. As you mentioned you probably have to manually track the completion of one job and then trigger execution of the next one. Best, Aljoscha On Fri, 24 Feb 2017 at 19:16 Mohit Anchlia wrote: > Is there a way to connect 2 workflows such