Re: Source reinterpretAsKeyedStream

2019-04-04 Thread Adrienne Kole
/test/java/org/apache/flink/streaming/api/datastream/ReinterpretDataStreamAsKeyedStreamITCase.java#L98 >> >> On Fri, Mar 29, 2019 at 6:09 AM Adrienne Kole >> wrote: >> >>> Dear community, >>> >>> I have a use-case where sources are keyed. >&

Source reinterpretAsKeyedStream

2019-03-29 Thread Adrienne Kole
Dear community, I have a use-case where sources are keyed. For example, there is a source function with parallelism 10, and each instance has its own key. I used reinterpretAsKeyedStream to convert source DataStream to KeyedStream, however, I get an IllegalArgument exception. Is reinterpretAsKeyed

Re: AllWindowed vs Windowed with 1 key

2017-05-08 Thread Adrienne Kole
wrote: > Hi, > > to answer this question, we would first need to know what you mean by > „global windows“: using „windowAll()“ or „GlobalWindows“? Also, the answer > might depend on the Flink version that you are using. > > Best, > Stefan > > > Am 07.05.20

AllWindowed vs Windowed with 1 key

2017-05-07 Thread Adrienne Kole
Hi, I am doing simple aggregation with a keyed and global windows in flink. When I compare the keyed window aggregation with 1 key and global window (which has parallelism 1) I would expect that both of them would have similar performance. However, keyed stream with 1 key performs with 2x more th

Flink Streaming Data Source Node

2016-11-22 Thread Adrienne Kole
Hi, I recognized that, if the number of data input sources are less than or equal to number of slots in one node, they (input source operators) are all deployed in the same node. What is the logic behind this? Can't this be a bottleneck for throughput and distribution of input sources? Thanks Ad

Re: Keyed join Flink Streaming

2016-10-13 Thread Adrienne Kole
wrote: Hey Adrienne! On Wed, Oct 12, 2016 at 4:10 PM, Adrienne Kole wrote: > Hi, > > I have 2 streams which are partitioned based on key field. I want to join > those streams based on key fields on windows. This is an example I saw in > the flink website: > > val firstInp

Keyed join Flink Streaming

2016-10-12 Thread Adrienne Kole
Hi, I have 2 streams which are partitioned based on key field. I want to join those streams based on key fields on windows. This is an example I saw in the flink website: val firstInput: DataStream[MyType] = ... val secondInput: DataStream[AnotherType] = ... val firstKeyed = firstInput.keyBy("u