Re: Comment in source code of CoGroupedStreams

2021-02-01 Thread Piotr Nowojski
Hi Sudharsan, Sorry for maybe a bit late response, but as far as I can tell, this comment refers to this piece of code: public void apply(KEY key, W window, Iterable> values, Collector out) throws Exception { List oneValues = new ArrayList<>(); Lis

Re: Comment in source code of CoGroupedStreams

2021-01-26 Thread Dawid Wysakowicz
For the problem of the uid you can follow Guowei's advice. As for the comment, I think it means that all elements of a single key must fit into the memory when they're passed as iterators to the CoGroupFunction. Best, Dawid On 21/01/2021 21:32, Sudharsan R wrote: > Is this comment in the file >

Re: Comment in source code of CoGroupedStreams

2021-01-21 Thread Guowei Ma
Hi, I think you could try something like this firstStream .coGroup(secondStream) .where(_.id) .equalTo(_.id) .window(TumblingEventTimeWindows.of(Time.seconds(1))) .with(new MyCogroupFunction()) .uid("myCoGroup") Best, Guowei On Fri, Jan 22, 2021 at 4:33 AM Sudh

Comment in source code of CoGroupedStreams

2021-01-21 Thread Sudharsan R
Is this comment in the file flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/CoGroupedStreams.java accurate? " * Note: Right now, the groups are being built in memory so you need to ensure that they don't * get too big. Otherwise the JVM might crash." Looking at the s

Comment in source code of CoGroupedStreams

2021-01-21 Thread sudranga
Is this comment in the file flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/CoGroupedStreams.java accurate? " * Note: Right now, the groups are being built in memory so you need to ensure that they don't * get too big. Otherwise the JVM might crash." Looking at the s