Can not submit flink job via IP or VIP of jobmanager

2018-06-08 Thread xie wei
Hello Flink team, We use Flink on DCOS and have problems submitting a Flink job from within a container to the Flink cluster. Both the container and the Flink cluster are running inside DCOS, on different nodes. We have the following setup: Flink was installed on DCOS using the package from the

how is data partitoned and distributed for connected stream

2017-08-21 Thread xie wei
Hello Flink, assume there are two finite streams, stream1(s1)has only one event, stream2(s2)have 100 events, the parallelism is 2. Then doing stream1.connect(stream2).map(). How is the data partitioned and distributed to the CoMap instances? Is the event from s1 only available in one of the CoMap

Is watermark used by joining two streams

2017-07-28 Thread xie wei
Hello, i want to join two streams based on event time window, every stream has its own watermark, one has priodic watermark and the other has punctuated watermark. are the watermarks used to trigger the join? if yes, which one and how is it used? Thank you and best regards Wei

Is joined stream WindowedStream?

2017-07-25 Thread xie wei
Hello Flink, one question about join operator: Flink Docu said "Join two data streams on a given key and a common window",= does "common window" mean that the joined stream is windowedStream? If it is normal datastream (not windowed), could the stream be windowed aga= in with different window