Hi,
Not if it doesn’t happen to frequently. Otherwise you would spend most of your
time restarting jobs.
Best,
Aljoscha
> On 9. May 2017, at 08:23, Moiz S Jinia wrote:
>
> Thanks. Do you foresee any problems with canceling/starting the jobs whenever
> the patterns change?
>
> Moiz
>
> On We
Thanks. Do you foresee any problems with canceling/starting the jobs
whenever the patterns change?
Moiz
On Wed, May 3, 2017 at 4:57 PM, Aljoscha Krettek
wrote:
> Hi,
> Yes, this would work even though it requires canceling/restarting the job
> whenever the patterns change.
>
> Best,
> Aljoscha
Hi,
Yes, this would work even though it requires canceling/restarting the job
whenever the patterns change.
Best,
Aljoscha
> On 3. May 2017, at 12:36, Moiz S Jinia wrote:
>
> The kind of program I intend to submit would be one that sets up a
> StreamExecutionEnvironment, connects to a stream f
The kind of program I intend to submit would be one that sets up
a StreamExecutionEnvironment, connects to a stream from a Kafka topic, and
uses a PatternStream over the kafka events. I could have the jar for this
program readily available in the "jobmanager.web.upload.dir", and use the
REST API fo
Not sure I understand Operators. What I need is to have a Pattern that
starts consuming from a Kafka stream. And I need the Patterns to come and
go.
Another option that comes to mind is this -
The Patterns I'll need are well known in advance. Only certain parameters
such as the time duration of th
What would the pattern be added to. An existing custom operator?
The REST interface only allows for managing the lifecycle of a job, not
modifying their graph structure.
> On 3. May 2017, at 11:43, Moiz S Jinia wrote:
>
> Thanks for the references. Looking at the REST API, would adding new Pat
Thanks for the references. Looking at the REST API, would adding new
Patterns not work via this?
https://ci.apache.org/projects/flink/flink-docs-release-1.3/monitoring/rest_api.html#submitting-programs
Moiz
On Wed, May 3, 2017 at 2:52 PM, Aljoscha Krettek
wrote:
> Hi,
> For managing a Job you
Hi,
For managing a Job you can either use the bin/flink command-line tool or the
Rest API [1]. As for dynamically adding patterns, that’s outside of the scope
of Flink right now. There are, however, some users that implemented this on top
of Flink, see for example RBEA [2]. The basic idea is to
