Re: [Flink-Question] In Flink parallel computing, how do different windows receive the data of their own partition, that is, how does Window determine which partition number the current Window belongs

2019-03-04 Thread Piotr Nowojski
Hi, I’m not if I understand your question/concerns. As Rong Rong explained, key selector is used to assign records to window operators. Within key context, you do not have access to other keys/values in your operator/functions, so your reduce/process/… functions when processing key:1 won’t b

Re: [Flink-Question] In Flink parallel computing, how do different windows receive the data of their own partition, that is, how does Window determine which partition number the current Window belongs

2019-03-03 Thread 刘 文
Sorry, I still don't understand. Can I ask for help again? For example, the degree of parallelism is 2, which will produce two Window threads. ).setParallelism(2) ).These two windows are how to read their own partition data. ).input data 1 2 3 4 5 6 7 8 9 10 ).source -> operator -> Rec

Re: [Flink-Question] In Flink parallel computing, how do different windows receive the data of their own partition, that is, how does Window determine which partition number the current Window belongs

2019-03-03 Thread Rong Rong
Hi I am not sure if I understand your question correctly, so will try to explain the flow how elements gets into window operators. Flink makes the partition assignment before invoking the operator to process element. For the word count example, WindowOperator is invoked by StreamInputProcessor[1]

Re: Flink Question

2018-11-14 Thread Tzu-Li (Gordon) Tai
Hi Steve, I’m not sure what you mean by “replacing addSource with CSV String data”. Are your Kinesis records CSV and you want to parse them into Events? If so, you should be able to do that in the provided DeserializationSchema. Cheers, Gordon On 9 November 2018 at 10:54:22 PM, Steve Bistline