Re: Associative operation + windowAll - possible parallelism

2017-07-12 Thread Debski
Thanks for the suggestions, I will take a look at transform function. -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Associative-operation-windowAll-possible-parallelism-tp14187p14204.html Sent from the Apache Flink User Mailing List archiv

Associative operation + windowAll - possible parallelism

2017-07-11 Thread Debski
Let us assume that I want to perform some kind of aggregation in specified time windows (e.g. tumbling window of 1 minute) and my aggregation operation is associative. Wouldn't it be possible to represent windowAll in runtime as /parallelism + 1/ operator instances where /parallelism/ number of ope

Re: elastic-search connector for 1.3.1 not working for local environemnt

2017-07-07 Thread Debski
I've found out the source of the problem when I build flink locally. elastic-search base depends on (by default) ES version 1.7.1 that depends on asm 4.1 and that version is shaded to elasticsearch-base-jar. I tried to set elasticsearch.version property in Maven to 5.1.2 (the same as elasticsearch5

elastic-search connector for 1.3.1 not working for local environemnt

2017-07-07 Thread Debski
Today I added flink-connector-ealsticsearch to my project and when I started flink engine using createLocalEnvironmentWithWebUI method I got following exception xception in thread "main" java.lang.IllegalArgumentException at org.apache.flink.shaded.org.objectweb.asm.ClassVisitor.(Unknown S