Re: Need help using AggregateFunction instead of FoldFunction

2019-12-06 Thread devinbost
on-based window. devinbost wrote > I added logging statements everywhere in my code, and I'm able to see my > message reach the `add` method in the AggregateFunction that I > implemented, > but the getResult method is never called. > > In the code below, I also never see the

Re: Need help using AggregateFunction instead of FoldFunction

2019-12-05 Thread devinbost
They released Pulsar 2.4.2, and I was able to pull its dependencies and successfully submit the Flink job. It's able to receive messages from the Pulsar topic successfully. However, I still don't think I'm using the AggregateFunction correctly. I added logging statements everywhere in my code, an

Re: Need help using AggregateFunction instead of FoldFunction

2019-12-04 Thread devinbost
It turns out that the exception that I was getting is actually related to Pulsar since I'm using the Pulsar Flink connector. I found the exact issue reported here: https://github.com/apache/pulsar/issues/4721 devinbost wrote > I was able to make more progress (based on the documenta

Re: Need help using AggregateFunction instead of FoldFunction

2019-12-04 Thread devinbost
sult(Tuple2 accumulator) { return "[" + accumulator.f1 + "]"; } @Override public Tuple2 merge(Tuple2 a, Tuple2 b) { return new Tuple2<>(a.f0, a.f1 + ", " + b.f1); } } vino yang wrote > Hi devinbost, > > Sharing two example link

Need help using AggregateFunction instead of FoldFunction

2019-12-04 Thread devinbost
Hi, In my use case, I am attempting to create a keyedStream (on a string) and then window that stream (which represents keyed JSON objects) with EventTimeSessionWindows (so that I have a separate window for each set of JSON messages, according to the key), and then concatenate the JSON objects by